Human Generated Data

Title

Untitled (group of debutantes seen from above)

Date

1970s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.566

Human Generated Data

Title

Untitled (group of debutantes seen from above)

People

Artist: Bachrach Studios, founded 1868

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Room 99.9
Indoors 99.9
Crowd 99.7
Human 99.7
Theater 98.8
Orchestra 95.5
Concert 95.5
Musical Instrument 95.5
Auditorium 94.3
Hall 94.3
Interior Design 88.9
Person 85.5
Chair 84.7
Furniture 84.7
Person 81.3
Person 74.9
People 71
Person 68.2
Person 41.7

Imagga
created on 2022-02-26

theater curtain 92.4
curtain 79.2
blind 55.2
hall 51.2
protective covering 37
crowd 25.9
silhouette 25.6
stage 23.1
event 22.2
people 21.7
audience 20.5
covering 19.4
design 17.4
interior 16.8
person 15.4
lights 14.8
party 13.7
celebration 13.5
music 13.5
man 13.4
flag 13
cheering 12.7
night 12.4
platform 12.4
bright 12.1
group 12.1
art 11.8
concert 11.6
decoration 11.6
patriotic 11.5
nation 11.3
male 11.3
icon 11.1
entertainment 11
black 10.8
building 10.7
stadium 10.7
championship 10.7
weapon 10.6
match 10.6
dance 10.6
skill 10.6
muscular 10.5
athlete 10.4
culture 10.2
training 10.2
architecture 10.1
symbol 10.1
competition 10.1
light 10
city 10
vintage 9.9
versus 9.8
nighttime 9.8
old 9.7
room 9.7
vibrant 9.6
dangerous 9.5
elegant 9.4
grunge 9.4
vivid 9.3
protection 9.1
sport 9.1
texture 9
religion 9
stab 8.9
fencing 8.9
technique 8.8
sword 8.8
disco 8.8
blade 8.7
fight 8.7
gear 8.7
ancient 8.6
performance 8.6
holiday 8.6
sharp 8.5
wall 8.5
show 8.5
classic 8.3
church 8.3
shadow 8.1
fireplace 7.9
musical 7.7
shop 7.4
shoe shop 7.3
indoor 7.3
graphic 7.3
cinema 7.2
home 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 90.3
text 60.4

Face analysis

Amazon

AWS Rekognition

Age 14-22
Gender Male, 99%
Calm 97.8%
Confused 0.9%
Happy 0.4%
Sad 0.3%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 9-17
Gender Male, 78.6%
Calm 40.5%
Sad 18.5%
Disgusted 13.3%
Fear 7%
Angry 6.6%
Happy 6.3%
Confused 5.3%
Surprised 2.5%

AWS Rekognition

Age 10-18
Gender Male, 85.4%
Calm 79%
Happy 6%
Sad 4.9%
Confused 3.4%
Surprised 2.3%
Disgusted 1.6%
Angry 1.4%
Fear 1.3%

AWS Rekognition

Age 18-24
Gender Female, 86.7%
Calm 72.5%
Surprised 10.2%
Fear 9.8%
Sad 2.6%
Angry 2%
Disgusted 1.9%
Happy 0.7%
Confused 0.2%

AWS Rekognition

Age 4-10
Gender Male, 99.2%
Calm 42.7%
Fear 18.5%
Happy 13.9%
Sad 12.1%
Disgusted 4.4%
Angry 3.9%
Confused 2.7%
Surprised 1.7%

AWS Rekognition

Age 10-18
Gender Female, 62.8%
Calm 47.9%
Sad 47.4%
Fear 1.2%
Happy 0.9%
Angry 0.8%
Disgusted 0.7%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 22-30
Gender Male, 80.5%
Calm 62.4%
Surprised 13.2%
Fear 12.6%
Disgusted 3.3%
Angry 3%
Sad 2.4%
Happy 1.7%
Confused 1.4%

AWS Rekognition

Age 23-33
Gender Female, 70.6%
Fear 33.6%
Calm 29.5%
Sad 18%
Happy 9.2%
Surprised 4.7%
Confused 2.2%
Disgusted 1.7%
Angry 1.2%

AWS Rekognition

Age 6-12
Gender Female, 88.5%
Calm 91.4%
Sad 3.6%
Happy 2%
Angry 0.9%
Confused 0.6%
Fear 0.6%
Disgusted 0.5%
Surprised 0.5%

AWS Rekognition

Age 18-26
Gender Female, 95.7%
Calm 94.1%
Sad 1.8%
Angry 1.2%
Fear 0.9%
Happy 0.6%
Disgusted 0.6%
Confused 0.6%
Surprised 0.3%

AWS Rekognition

Age 10-18
Gender Male, 74.7%
Calm 92.8%
Sad 1.8%
Angry 1.6%
Happy 1.2%
Confused 1.2%
Disgusted 0.6%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 96.7%
Calm 92%
Happy 4%
Sad 1.2%
Confused 0.9%
Angry 0.9%
Disgusted 0.6%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 18-24
Gender Female, 71.9%
Calm 78.7%
Sad 7.9%
Happy 4.6%
Fear 3%
Angry 2.7%
Surprised 1.8%
Disgusted 1.1%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 71.5%
Calm 82.9%
Happy 4.2%
Sad 3.7%
Angry 2.6%
Fear 2.4%
Confused 1.6%
Surprised 1.5%
Disgusted 1%

AWS Rekognition

Age 6-14
Gender Male, 88.3%
Calm 92.6%
Angry 2.8%
Happy 2.7%
Sad 0.7%
Confused 0.7%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-14
Gender Male, 88.8%
Calm 96.6%
Happy 2.2%
Confused 0.5%
Angry 0.3%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 10-18
Gender Male, 96.3%
Calm 67.8%
Sad 8.1%
Angry 7.1%
Confused 4.7%
Disgusted 4.3%
Surprised 4%
Fear 2.3%
Happy 1.6%

AWS Rekognition

Age 14-22
Gender Male, 93.5%
Calm 88.8%
Angry 4.1%
Sad 2.7%
Happy 1.7%
Disgusted 0.8%
Confused 0.7%
Fear 0.7%
Surprised 0.6%

AWS Rekognition

Age 16-22
Gender Female, 73.5%
Calm 70.5%
Angry 20.9%
Sad 3.1%
Happy 2%
Confused 1.4%
Disgusted 0.9%
Fear 0.8%
Surprised 0.4%

AWS Rekognition

Age 6-14
Gender Female, 90.1%
Calm 77.8%
Sad 4.9%
Angry 4.8%
Happy 3.4%
Fear 3.3%
Confused 2.8%
Disgusted 1.9%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Calm 97.9%
Sad 0.6%
Happy 0.5%
Surprised 0.2%
Fear 0.2%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 13-21
Gender Male, 87.1%
Calm 93.5%
Angry 2.3%
Sad 1.8%
Happy 1.1%
Confused 0.5%
Fear 0.4%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 7-17
Gender Male, 89.1%
Calm 86.8%
Sad 3.3%
Angry 2.6%
Happy 2.5%
Confused 2%
Fear 1.4%
Disgusted 1%
Surprised 0.4%

AWS Rekognition

Age 16-22
Gender Female, 50.1%
Calm 52.6%
Angry 37.9%
Disgusted 3.4%
Sad 2.4%
Confused 1.7%
Happy 1.1%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 6-14
Gender Male, 98.4%
Calm 85.3%
Angry 7.3%
Sad 2.4%
Confused 1.2%
Disgusted 1.2%
Fear 1%
Happy 1%
Surprised 0.6%

AWS Rekognition

Age 19-27
Gender Female, 78.4%
Calm 81.9%
Happy 7.5%
Confused 2.8%
Angry 2.8%
Sad 2.4%
Fear 1.3%
Disgusted 0.9%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.5%
Calm 98%
Angry 0.7%
Sad 0.4%
Happy 0.3%
Confused 0.2%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Female, 56.8%
Angry 79.9%
Calm 18.3%
Confused 0.6%
Happy 0.4%
Sad 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 14-22
Gender Male, 97.2%
Calm 95.9%
Happy 1.8%
Angry 0.6%
Confused 0.5%
Sad 0.5%
Fear 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 6-14
Gender Male, 99.6%
Calm 95.3%
Confused 1.9%
Angry 0.8%
Disgusted 0.6%
Happy 0.5%
Sad 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 16-24
Gender Female, 56.5%
Calm 94.4%
Happy 1.9%
Sad 1.4%
Angry 0.7%
Confused 0.5%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 11-19
Gender Female, 51.5%
Calm 90.3%
Sad 2.4%
Happy 2.3%
Fear 1.7%
Angry 1.4%
Disgusted 0.9%
Confused 0.8%
Surprised 0.3%

AWS Rekognition

Age 16-22
Gender Male, 96.8%
Calm 90.7%
Sad 2%
Happy 1.9%
Angry 1.7%
Disgusted 1.5%
Confused 1%
Fear 0.6%
Surprised 0.6%

AWS Rekognition

Age 6-16
Gender Male, 99.5%
Calm 64.9%
Confused 20%
Angry 5.3%
Sad 4.6%
Happy 2.9%
Fear 0.9%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 14-22
Gender Male, 54.1%
Calm 64.8%
Sad 9.6%
Angry 8.4%
Happy 6.3%
Fear 3.5%
Disgusted 3.1%
Surprised 2.9%
Confused 1.4%

AWS Rekognition

Age 12-20
Gender Male, 98.9%
Calm 90.2%
Happy 4.4%
Sad 3.3%
Angry 0.7%
Confused 0.5%
Disgusted 0.5%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Male, 92.9%
Sad 40.6%
Fear 34.5%
Calm 21.9%
Angry 1%
Happy 0.9%
Disgusted 0.4%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 16-24
Gender Female, 65.8%
Angry 68.4%
Calm 29%
Sad 0.8%
Happy 0.8%
Fear 0.4%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 16-22
Gender Male, 78.7%
Calm 86.1%
Sad 3.8%
Happy 3.2%
Angry 2.6%
Disgusted 1.6%
Fear 1.3%
Surprised 0.9%
Confused 0.5%

AWS Rekognition

Age 13-21
Gender Male, 84%
Calm 78.5%
Sad 11.6%
Confused 3.1%
Angry 2%
Fear 1.8%
Happy 1.3%
Disgusted 0.9%
Surprised 0.7%

AWS Rekognition

Age 14-22
Gender Female, 50.1%
Calm 96.9%
Happy 1.1%
Sad 0.6%
Angry 0.4%
Surprised 0.3%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 64.8%
Calm 89.5%
Happy 4.9%
Angry 3.4%
Confused 1.1%
Sad 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 72.3%
Calm 99.5%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Male, 97%
Calm 91.7%
Angry 2.6%
Happy 2.5%
Sad 1.1%
Surprised 0.6%
Confused 0.6%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Female, 75.8%
Calm 92.5%
Happy 2.8%
Angry 2.4%
Sad 1%
Confused 0.5%
Disgusted 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.7%
Calm 77.8%
Happy 9.7%
Surprised 3.1%
Angry 2.7%
Fear 2.3%
Sad 2.2%
Confused 1.2%
Disgusted 1%

AWS Rekognition

Age 18-24
Gender Male, 74.2%
Calm 96.5%
Sad 1.2%
Happy 1.1%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 12-20
Gender Male, 99.4%
Calm 91.1%
Surprised 3.2%
Confused 2.1%
Angry 1.5%
Disgusted 0.9%
Sad 0.5%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 13-21
Gender Male, 97.6%
Sad 73.2%
Calm 15.3%
Angry 5%
Happy 3%
Confused 1.7%
Disgusted 0.9%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 13-21
Gender Male, 84%
Calm 90.2%
Sad 3.3%
Confused 2.5%
Angry 1.5%
Happy 1.3%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 7-17
Gender Male, 99.9%
Calm 92.5%
Sad 3.6%
Angry 1.1%
Confused 0.7%
Surprised 0.6%
Happy 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Sad 85.1%
Calm 11.2%
Happy 1.9%
Angry 0.7%
Disgusted 0.4%
Confused 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Female, 57.9%
Calm 73.1%
Happy 15.5%
Sad 5.9%
Confused 1.6%
Angry 1.4%
Fear 1%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 85.4%
Sad 3.5%
Disgusted 2.7%
Angry 2.3%
Happy 2%
Surprised 1.8%
Confused 1.5%
Fear 0.8%

AWS Rekognition

Age 13-21
Gender Male, 77%
Calm 96.4%
Happy 1.7%
Angry 0.6%
Confused 0.6%
Sad 0.4%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.2%
Fear 53.8%
Calm 35.7%
Sad 5.2%
Happy 1.7%
Angry 1.5%
Surprised 0.8%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 6-14
Gender Male, 81%
Calm 96.5%
Confused 1.5%
Disgusted 0.7%
Happy 0.3%
Fear 0.3%
Sad 0.3%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 18-24
Gender Male, 84%
Calm 89.5%
Happy 4.2%
Angry 2.2%
Confused 1.3%
Fear 0.8%
Sad 0.8%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 6-14
Gender Male, 98.6%
Calm 73.3%
Sad 13.3%
Angry 6.5%
Confused 4.4%
Disgusted 0.8%
Fear 0.7%
Happy 0.7%
Surprised 0.3%

AWS Rekognition

Age 6-14
Gender Male, 55.3%
Calm 86.4%
Confused 3.5%
Sad 3.4%
Happy 3.1%
Fear 2%
Surprised 0.6%
Disgusted 0.5%
Angry 0.5%

AWS Rekognition

Age 9-17
Gender Male, 91.3%
Calm 98.2%
Happy 0.5%
Sad 0.3%
Confused 0.3%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%

Feature analysis

Amazon

Person 85.5%

Captions

Microsoft

a group of people standing in front of a crowd 31.5%
a group of people in front of a crowd 31.4%
a group of people on a stage in front of a crowd 31.1%