Human Generated Data

Title

Untitled (three men holding radios in front of band and Jello display)

Date

1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4214

Human Generated Data

Title

Untitled (three men holding radios in front of band and Jello display)

People

Artist: Durette Studio, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.8
Person 98.8
Person 97.5
Person 97.4
Person 97.4
Person 97.1
Person 95.8
Clinic 84.8
Person 82.8
Interior Design 82.1
Indoors 82.1
People 71.6
Furniture 69.7
Person 69.7
Lighting 68.6
Table 62.7
Face 60
Photography 60
Photo 60
Portrait 60
Hospital 59
Text 55.8

Clarifai
created on 2019-06-01

people 99.6
group 98.9
man 98.4
adult 97.8
group together 96.6
woman 96.5
many 92.2
leader 90.8
room 90
indoors 89.7
furniture 89
several 86.5
three 81.9
administration 78.7
two 75.7
four 75.5
war 72.5
five 71.8
sit 71.4
league 69

Imagga
created on 2019-06-01

business 27.3
people 20.6
professional 18.1
office 18
man 17.8
person 17.5
negative 17.3
work 16.5
technology 16.3
businessman 15
adult 14.9
architecture 14.1
silhouette 14.1
design 14.1
building 13.9
film 13.6
male 13.5
city 12.5
doctor 12.2
group 12.1
worker 11.5
medical 11.5
symbol 11.4
baron 11.3
construction 11.1
art 10.8
sign 10.5
photographic paper 10.5
urban 10.5
reflection 10.4
equipment 10.2
house 10
life 9.9
team 9.8
modern 9.8
family 9.8
medicine 9.7
hands 9.5
cityscape 9.5
plan 9.4
men 9.4
happy 9.4
hand 9.1
nurse 9
job 8.8
working 8.8
facility 8.6
paper 8.6
corporate 8.6
grunge 8.5
manager 8.4
sky 8.3
human 8.2
success 8
graphic 8
clinic 7.8
portrait 7.8
space 7.8
casual 7.6
finance 7.6
skyline 7.6
communication 7.6
teamwork 7.4
room 7.3
confident 7.3
lifestyle 7.2
science 7.1
photographic equipment 7

Google
created on 2019-06-01

Photograph 97.5
White 97.3
Text 88.1
Snapshot 86.4
Black-and-white 80.7
Photography 73.8
Font 68.6
Stock photography 66.6
Room 65.7
Ceremony 52.5
Family 50.2

Microsoft
created on 2019-06-01

clothing 86.5
person 84.4
man 81.9
old 64.8
posing 53.1
ship 50.9

Face analysis

Amazon

AWS Rekognition

Age 16-27
Gender Male, 54.7%
Disgusted 45.4%
Sad 46.1%
Confused 45.3%
Happy 45.2%
Angry 45.3%
Surprised 45.2%
Calm 52.5%

AWS Rekognition

Age 26-43
Gender Male, 51.3%
Happy 47.5%
Confused 45.4%
Angry 45.3%
Sad 48.1%
Calm 47.7%
Surprised 45.4%
Disgusted 45.4%

AWS Rekognition

Age 19-36
Gender Female, 54.8%
Sad 46.2%
Angry 46.3%
Surprised 46.1%
Calm 45.9%
Disgusted 48.2%
Happy 46.7%
Confused 45.5%

AWS Rekognition

Age 23-38
Gender Female, 51.5%
Disgusted 47.7%
Calm 45.5%
Angry 46.2%
Sad 48.8%
Happy 45.7%
Surprised 45.6%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Male, 54.5%
Happy 53.3%
Disgusted 45.2%
Angry 45.2%
Surprised 45.3%
Sad 45.3%
Calm 45.4%
Confused 45.3%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Disgusted 45.2%
Sad 46.1%
Surprised 46.1%
Happy 45.4%
Angry 46.5%
Calm 49.8%
Confused 45.8%

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Happy 45.6%
Calm 48.1%
Angry 45.4%
Surprised 47.1%
Disgusted 45.4%
Confused 46.8%
Sad 46.7%

AWS Rekognition

Age 35-52
Gender Female, 51.6%
Sad 45.7%
Angry 50.7%
Disgusted 45.3%
Surprised 45.4%
Happy 45.5%
Calm 46.8%
Confused 45.7%

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 63.7%
a vintage photo of a group of people posing for a picture 63.6%
a group of people posing for a photo 63.5%

Text analysis

Amazon

JELLO
FLAVORS
ELLO
6DELICIOUS FLAVORS
6DELICIOUS

Google

JELLO
DELICIOUS
FLAVORS
DEL 6 DELICIOUS FLAVORS JELLO MAXWELL
DEL
MAXWELL
6