Human Generated Data

Title

Untitled (young girls and boys with matching outfits standing at banquet table with Christmas tree in background)

Date

1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4168

Human Generated Data

Title

Untitled (young girls and boys with matching outfits standing at banquet table with Christmas tree in background)

People

Artist: Durette Studio, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.9
Person 98.9
Person 98.5
Person 98.1
Person 97.8
Person 97.8
Person 95.9
Crowd 95
Indoors 83.5
People 75.1
Person 72.2
Room 71.3
Audience 67.5
Person 66.2
Person 60.5
Workshop 59.9
Clinic 59.9
Parade 59.3
Clothing 58
Apparel 58
Table 57.2
Furniture 57.2
Wedding 56.1
Person 42.8

Clarifai
created on 2019-06-01

people 99.7
many 98.6
group together 98.5
crowd 97.1
man 96.9
group 96.8
adult 94.7
woman 92.5
leader 91.3
military 88.1
uniform 86.1
war 84.1
wear 82.3
outfit 81.3
administration 76.9
boy 76.5
soldier 76.1
queue 75.1
school 73.8
education 73.8

Imagga
created on 2019-06-01

shoe shop 89.3
shop 73.2
mercantile establishment 55.7
place of business 37.3
people 35.1
man 30.2
person 27.4
male 26.2
room 26
adult 25.2
professional 24.1
men 24
business 23.7
women 22.1
group 20.9
work 20.4
businessman 20.3
table 19.9
smiling 19.5
happy 18.8
establishment 18.6
interior 18.6
hall 18.3
teacher 16.9
indoors 16.7
indoor 16.4
corporate 16.3
sitting 16.3
office 16.2
hospital 16.2
worker 16
businesswoman 15.4
team 15.2
job 15
smile 15
modern 14
couple 13.9
businesspeople 13.3
teamwork 13
home 12.8
casual 12.7
colleagues 12.6
together 12.3
life 12.2
two 11.9
cheerful 11.4
desk 11.3
education 11.2
looking 11.2
color 11.1
nurse 11
portrait 11
lifestyle 10.8
working 10.6
medical 10.6
career 10.4
meeting 10.4
happiness 10.2
executive 10.1
clothing 10.1
occupation 10.1
educator 9.9
attractive 9.8
computer 9.6
talking 9.5
doctor 9.4
light 9.4
communication 9.2
face 9.2
classroom 8.7
day 8.6
furniture 8.6
design 8.4
manager 8.4
house 8.4
student 8.3
holding 8.2
human 8.2
laptop 8.2
confident 8.2
suit 8.1
success 8
family 8
associates 7.9
hand 7.6
mature 7.4
window 7.4
love 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wedding dress 91.1
person 89.5
clothing 87.8
bride 75.8
man 73.3
woman 68.7
group 66.8
black and white 57.4
posing 36.1

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Disgusted 45.2%
Calm 51.3%
Sad 46.9%
Confused 45.3%
Angry 45.4%
Surprised 45.5%
Happy 45.5%

AWS Rekognition

Age 30-47
Gender Male, 54.7%
Calm 48.9%
Disgusted 45.2%
Sad 50.2%
Surprised 45.1%
Happy 45.3%
Confused 45.2%
Angry 45.2%

AWS Rekognition

Age 27-44
Gender Male, 52.1%
Happy 46.5%
Confused 45.2%
Disgusted 45.1%
Sad 45.8%
Calm 52%
Angry 45.2%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Confused 45.5%
Surprised 45.6%
Happy 45.8%
Calm 51.7%
Sad 45.9%
Disgusted 45.3%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Male, 52.3%
Angry 45.5%
Calm 47.2%
Sad 49.9%
Surprised 45.4%
Disgusted 45.4%
Happy 46.3%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 45.5%
Confused 46.2%
Angry 45.9%
Calm 47.8%
Surprised 46.6%
Happy 45.7%
Sad 47.2%

AWS Rekognition

Age 38-57
Gender Male, 54.7%
Disgusted 45.3%
Calm 50.4%
Surprised 45.2%
Angry 45.8%
Happy 45.4%
Sad 47.3%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Sad 49.3%
Angry 45.5%
Happy 46.7%
Confused 45.7%
Calm 46.2%
Surprised 45.5%
Disgusted 46%

AWS Rekognition

Age 20-38
Gender Female, 51.5%
Angry 45.4%
Disgusted 45.7%
Confused 45.5%
Calm 46.1%
Sad 51.3%
Surprised 45.4%
Happy 45.7%

AWS Rekognition

Age 26-43
Gender Male, 50.8%
Disgusted 45.1%
Calm 51.7%
Confused 45.2%
Sad 46.2%
Surprised 45.3%
Angry 45.3%
Happy 46.2%

AWS Rekognition

Age 27-44
Gender Male, 51.8%
Surprised 45.2%
Sad 47.6%
Happy 45.3%
Angry 45.2%
Disgusted 45.3%
Confused 45.2%
Calm 51.1%

AWS Rekognition

Age 26-43
Gender Male, 52.7%
Angry 45.3%
Sad 50.3%
Surprised 45.2%
Happy 45.3%
Calm 48.5%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 48-68
Gender Male, 54.2%
Angry 45.3%
Sad 45.5%
Happy 45.1%
Confused 45.7%
Surprised 45.3%
Calm 51.2%
Disgusted 46.9%

AWS Rekognition

Age 26-43
Gender Male, 50.9%
Disgusted 45.2%
Calm 46.2%
Sad 52.6%
Confused 45.2%
Angry 45.2%
Surprised 45.2%
Happy 45.4%

AWS Rekognition

Age 35-52
Gender Female, 51.2%
Disgusted 45.1%
Calm 47.9%
Confused 45.3%
Sad 50.4%
Surprised 45.1%
Angry 45.4%
Happy 45.8%

AWS Rekognition

Age 23-38
Gender Female, 51.7%
Angry 46.4%
Happy 45.2%
Sad 51.6%
Disgusted 45%
Confused 45.1%
Calm 46.5%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Calm 46.2%
Disgusted 50.2%
Confused 46.8%
Surprised 45.8%
Happy 45.4%
Sad 45.4%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.6%
Sad 50%
Calm 49.6%
Happy 49.6%
Surprised 49.6%
Disgusted 49.5%
Angry 49.7%

AWS Rekognition

Age 26-44
Gender Female, 51.9%
Calm 47.4%
Surprised 45.5%
Disgusted 45.2%
Happy 47.4%
Sad 48.6%
Confused 45.5%
Angry 45.3%

AWS Rekognition

Age 26-44
Gender Female, 54%
Happy 45.6%
Angry 45.4%
Surprised 45.2%
Disgusted 45.4%
Sad 49.3%
Calm 48.4%
Confused 45.6%

AWS Rekognition

Age 45-63
Gender Male, 50.7%
Angry 45.7%
Disgusted 45.3%
Confused 46.2%
Calm 48.4%
Sad 48%
Surprised 45.2%
Happy 46.3%

AWS Rekognition

Age 27-44
Gender Female, 50%
Happy 45.2%
Confused 45.2%
Angry 45.3%
Disgusted 45.6%
Surprised 45.2%
Sad 46.3%
Calm 52.2%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Disgusted 45.3%
Calm 48.5%
Angry 45.9%
Sad 48.4%
Happy 45.6%
Surprised 45.5%
Confused 45.9%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Surprised 45.3%
Sad 45.6%
Happy 45.4%
Angry 45.2%
Disgusted 45.2%
Confused 45.4%
Calm 53%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Confused 49.5%
Surprised 49.5%
Calm 50.3%
Sad 49.5%
Happy 49.6%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Angry 45.5%
Confused 45.4%
Surprised 45.4%
Happy 45.5%
Sad 47.4%
Calm 50.4%
Disgusted 45.4%

AWS Rekognition

Age 35-52
Gender Female, 53.4%
Happy 47.5%
Confused 45.8%
Angry 45.8%
Sad 45.6%
Calm 47.6%
Surprised 46.3%
Disgusted 46.4%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Surprised 45.1%
Disgusted 45.1%
Calm 49%
Happy 45.4%
Sad 49.9%
Angry 45.2%
Confused 45.1%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Surprised 49.6%
Disgusted 49.9%
Calm 49.6%
Happy 49.6%
Sad 49.6%
Angry 49.7%
Confused 49.6%

AWS Rekognition

Age 38-57
Gender Male, 50%
Disgusted 49.6%
Calm 49.8%
Angry 49.6%
Sad 49.8%
Surprised 49.6%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Sad 50%
Surprised 49.6%
Happy 49.5%
Angry 49.6%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Happy 49.9%
Disgusted 49.5%
Angry 49.5%
Calm 49.6%
Sad 49.8%
Confused 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Happy 45.2%
Disgusted 45.1%
Angry 45.4%
Calm 47.1%
Sad 51.9%
Confused 45.2%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Angry 45.3%
Surprised 45.4%
Calm 53%
Sad 45.3%
Confused 45.4%
Disgusted 45.3%
Happy 45.3%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 49.8%
Confused 49.6%
Disgusted 49.5%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Calm 49.9%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Disgusted 49.6%
Sad 49.9%
Happy 49.7%
Confused 49.6%
Surprised 49.6%
Angry 49.6%
Calm 49.6%

AWS Rekognition

Age 27-44
Gender Male, 50.3%
Angry 45.3%
Disgusted 45.2%
Happy 45.6%
Sad 50.9%
Surprised 45.3%
Calm 47.3%
Confused 45.4%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Happy 49.6%
Surprised 49.5%
Angry 49.5%
Confused 49.6%
Calm 50%
Sad 49.8%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Happy 50.1%
Calm 49.6%
Angry 49.5%
Confused 49.5%
Surprised 49.5%
Sad 49.7%
Disgusted 49.6%

AWS Rekognition

Age 35-55
Gender Female, 54.5%
Happy 45%
Confused 45.8%
Disgusted 45.1%
Sad 52.6%
Calm 46.1%
Angry 45.1%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Sad 49%
Confused 45.7%
Disgusted 45.4%
Surprised 45.2%
Angry 45.6%
Happy 45.4%
Calm 48.8%

AWS Rekognition

Age 15-25
Gender Male, 50.5%
Confused 49.6%
Angry 49.6%
Sad 49.7%
Calm 49.9%
Disgusted 49.7%
Happy 49.5%
Surprised 49.6%

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 85%
a group of people posing for a photo in front of a crowd 84.9%
a group of people standing in front of a crowd 84.8%