Human Generated Data

Title

Untitled (rephotographed portrait of large family seated in living room)

Date

1958

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11141

Human Generated Data

Title

Untitled (rephotographed portrait of large family seated in living room)

People

Artist: Claseman Studio, American 20th century

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Human 99.6
Person 99.6
Person 98.5
Person 97.9
Person 97.5
Person 97.5
Person 96.5
Person 93.4
Person 92.4
Person 91.7
Person 90.6
Accessories 88.5
Tie 88.5
Accessory 88.5
Person 86.9
People 83
Clothing 81.1
Apparel 81.1
Tie 80.8
Helmet 76.5
Furniture 76
Chair 76
Person 74.6
Face 72.7
Clinic 67
Photography 62.9
Photo 62.9
Crowd 62.4
Tie 61.9
Electronics 56.9
Screen 56.9
Helmet 56.5
Monitor 55
Display 55

Clarifai
created on 2019-03-26

people 99.5
group 99.1
adult 97.2
group together 96.3
woman 94.7
man 94.4
leader 94.3
many 93.3
education 90.4
several 88
room 85.6
furniture 84.7
five 84.5
indoors 84.2
four 83.3
administration 82.2
three 79
wear 76.6
chair 72.3
outfit 71.5

Imagga
created on 2019-03-26

man 39.7
kin 37.3
people 33.4
male 32.6
adult 30.3
person 28.2
businessman 24.7
business 23.7
professional 22.2
couple 20.9
senior 20.6
women 20.5
office 20.2
room 20.1
home 19.9
men 19.7
smiling 19.5
meeting 18.8
team 17.9
together 17.5
teacher 17.5
indoors 16.7
sitting 16.3
talking 16.1
working 15.9
mature 15.8
work 15.7
nurse 15.7
colleagues 15.5
worker 15.4
group 15.3
table 14.7
businesswoman 14.5
happy 14.4
businesspeople 14.2
interior 14.1
modern 14
portrait 13.6
job 13.3
teamwork 13
two 12.7
classroom 12.7
executive 12.4
communication 11.7
lifestyle 11.6
30s 11.5
cheerful 11.4
desk 11.3
indoor 10.9
smile 10.7
salon 10.6
elderly 10.5
life 10.3
camera 10.2
family 9.8
old 9.7
health 9.7
computer 9.6
educator 9.6
corporate 9.4
happiness 9.4
casual 9.3
medical 8.8
hospital 8.8
casual clothing 8.8
40s 8.8
two people 8.7
standing 8.7
education 8.7
four 8.6
doctor 8.5
house 8.3
patient 8.3
human 8.2
20s 8.2
care 8.2
laptop 8.2
looking 8
mother 8
clinic 7.9
discussing 7.9
discussion 7.8
older 7.8
mid adult 7.7
retirement 7.7
boss 7.6
student 7.6
friends 7.5
friendship 7.5
manager 7.4
holding 7.4
technology 7.4
coat 7.3
occupation 7.3
love 7.1
to 7.1
day 7.1

Google
created on 2019-03-26

Microsoft
created on 2019-03-26

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Calm 45.6%
Angry 45.4%
Happy 47.3%
Sad 51%
Confused 45.3%
Disgusted 45.1%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Happy 54.8%
Sad 45%
Angry 45%
Surprised 45.1%
Confused 45%
Calm 45%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Calm 47%
Confused 45.3%
Sad 45.5%
Angry 46.3%
Happy 49%
Surprised 46.6%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Surprised 45.7%
Happy 46.7%
Confused 45.3%
Sad 45.5%
Angry 45.3%
Disgusted 45.3%
Calm 51.2%

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Sad 45%
Calm 45%
Confused 45%
Happy 54.9%
Disgusted 45%
Surprised 45%
Angry 45%

AWS Rekognition

Age 35-52
Gender Male, 53.9%
Confused 45.4%
Disgusted 46.5%
Happy 45.4%
Calm 50%
Angry 45.5%
Surprised 45.5%
Sad 46.6%

AWS Rekognition

Age 23-38
Gender Female, 53.4%
Calm 50.2%
Happy 48.1%
Angry 45.3%
Disgusted 45.1%
Confused 45.3%
Sad 45.2%
Surprised 45.8%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Surprised 45.4%
Angry 45.5%
Disgusted 45.3%
Sad 45.5%
Happy 52.2%
Calm 46%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 53.1%
Sad 47.7%
Confused 45.3%
Disgusted 45.2%
Angry 45.5%
Surprised 45.6%
Happy 50.1%
Calm 45.7%

AWS Rekognition

Age 26-43
Gender Male, 51.9%
Sad 45.9%
Disgusted 46.8%
Happy 47.3%
Angry 45.5%
Confused 45.8%
Calm 47.6%
Surprised 46.1%

Feature analysis

Amazon

Person 99.6%
Tie 88.5%
Helmet 76.5%

Captions

Microsoft

a group of people posing for a photo in front of a window 91.3%
a group of people standing in front of a window 91.2%
a group of people standing in front of a window posing for the camera 88.3%