Human Generated Data

Title

Untitled (large group of little boys and girls on stage for Tom Thumb wedding)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3554

Human Generated Data

Title

Untitled (large group of little boys and girls on stage for Tom Thumb wedding)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Stage 97.3
Indoors 95.1
Human 93.1
Crowd 91.1
Room 90.1
Person 88.7
Furniture 88.2
Person 87.6
Interior Design 85.5
Person 82.2
Person 81.5
Audience 80.6
Person 77.6
Person 73.7
Person 71.1
Apparel 70.8
Overcoat 70.8
Clothing 70.8
Coat 70.8
Suit 70.8
People 70.4
Hall 69.6
Person 66.2
Auditorium 58.6
Theater 58.6
Press Conference 58.4
Couch 58.2
Court 58
Table 57.4
Ballroom 55.5
Chair 54.5

Imagga
created on 2022-01-22

room 46.3
classroom 39
hall 34
interior 33.6
chair 32.4
table 32.2
modern 26.6
house 24.2
home 20.7
furniture 20.2
office 19.7
building 19.3
restaurant 19.2
indoor 18.2
architecture 17.9
window 17.8
indoors 16.7
dining 16.2
design 15.7
glass 15.5
inside 14.7
people 14.5
urban 14
business 14
structure 13.5
women 13.4
man 13.4
city 13.3
decor 13.2
male 12.8
kitchen 12.5
lifestyle 12.3
floor 12.1
person 11.3
luxury 11.1
style 11.1
wood 10.8
chairs 10.8
education 10.4
empty 10.3
light 10
men 9.4
contemporary 9.4
blackboard 9.2
center 9.2
adult 9.1
seat 8.9
group 8.9
decoration 8.7
work 8.6
sitting 8.6
school 8.4
communication 8.4
teacher 8.2
shop 8
food 8
love 7.9
windows 7.7
desk 7.6
meeting 7.5
counter 7.4
place 7.4
smiling 7.2

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 88.8
window 80.8
black and white 75.6
text 74.6
white 73.9
clothing 61

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Male, 53.7%
Calm 68.9%
Sad 18%
Angry 4.1%
Happy 3.2%
Confused 2.7%
Disgusted 1.3%
Fear 1.2%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Sad 31.4%
Calm 22.2%
Angry 15%
Fear 14.8%
Happy 13.3%
Surprised 1.7%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 22-30
Gender Male, 88.9%
Calm 61.2%
Sad 26.8%
Happy 5.9%
Confused 2.3%
Angry 2%
Disgusted 0.7%
Fear 0.6%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Calm 61.9%
Sad 33.8%
Happy 1%
Confused 1%
Angry 0.8%
Surprised 0.6%
Fear 0.6%
Disgusted 0.4%

AWS Rekognition

Age 10-18
Gender Male, 78.7%
Happy 58.6%
Calm 33.4%
Sad 4.3%
Confused 1.2%
Angry 1%
Fear 0.6%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Male, 76.2%
Calm 41.1%
Surprised 16.3%
Sad 13.6%
Confused 10.8%
Disgusted 7.9%
Angry 3.6%
Fear 3.3%
Happy 3.3%

AWS Rekognition

Age 24-34
Gender Female, 71.6%
Sad 51.2%
Calm 21.4%
Happy 14.2%
Confused 4.7%
Angry 2.8%
Fear 2.3%
Surprised 2%
Disgusted 1.4%

AWS Rekognition

Age 16-24
Gender Male, 62.9%
Sad 98.1%
Calm 1%
Happy 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 16-24
Gender Female, 53.6%
Sad 76.7%
Calm 16.3%
Happy 2.4%
Angry 2.4%
Fear 0.9%
Disgusted 0.6%
Confused 0.5%
Surprised 0.2%

AWS Rekognition

Age 20-28
Gender Male, 69.3%
Calm 67.7%
Happy 18.3%
Sad 10%
Angry 1.4%
Confused 0.9%
Surprised 0.6%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 22-30
Gender Male, 88.9%
Happy 43.1%
Calm 39.5%
Sad 5.1%
Angry 3.8%
Fear 3.5%
Disgusted 2.3%
Surprised 1.5%
Confused 1.2%

AWS Rekognition

Age 16-24
Gender Female, 75.2%
Sad 60.2%
Calm 37%
Angry 1.3%
Happy 0.5%
Confused 0.4%
Fear 0.3%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Male, 56.7%
Calm 57.5%
Sad 10.3%
Happy 10%
Confused 7.3%
Disgusted 6.2%
Angry 4.1%
Surprised 2.9%
Fear 1.9%

AWS Rekognition

Age 28-38
Gender Male, 91%
Happy 42.5%
Sad 22.5%
Disgusted 12.3%
Confused 9%
Calm 4.4%
Angry 3.7%
Fear 2.8%
Surprised 2.8%

AWS Rekognition

Age 25-35
Gender Male, 97.6%
Sad 96.7%
Calm 1.2%
Confused 0.7%
Happy 0.7%
Angry 0.3%
Fear 0.3%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 25-35
Gender Male, 78%
Calm 83.4%
Confused 6.3%
Sad 3.5%
Happy 2%
Angry 1.8%
Disgusted 1.5%
Fear 0.8%
Surprised 0.7%

AWS Rekognition

Age 19-27
Gender Male, 86.7%
Calm 67.1%
Happy 16.3%
Sad 7.5%
Angry 5.7%
Confused 1.7%
Fear 0.8%
Disgusted 0.6%
Surprised 0.4%

AWS Rekognition

Age 22-30
Gender Male, 97.1%
Sad 87.7%
Calm 6.7%
Confused 1.4%
Happy 1.4%
Fear 1.2%
Angry 0.9%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Female, 93%
Calm 82.7%
Sad 10.6%
Happy 4.2%
Confused 1.2%
Angry 0.5%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Female, 56.9%
Calm 40.2%
Happy 30.3%
Sad 22.3%
Fear 2.8%
Angry 1.4%
Confused 1.1%
Surprised 1%
Disgusted 0.9%

AWS Rekognition

Age 19-27
Gender Male, 96.5%
Sad 45.6%
Happy 26.2%
Calm 17.8%
Fear 4.6%
Angry 2%
Confused 1.9%
Surprised 1.1%
Disgusted 1%

AWS Rekognition

Age 26-36
Gender Male, 83.7%
Happy 84%
Sad 4.1%
Calm 4.1%
Confused 2.6%
Angry 1.8%
Disgusted 1.8%
Surprised 1.1%
Fear 0.6%

Feature analysis

Amazon

Person 88.7%
Chair 54.5%

Captions

Microsoft

a group of people standing in front of a window 79%
a crowd of people standing in front of a window 78.9%
a group of people in front of a window 76.1%

Text analysis

Amazon

2
KODAK
SAFETY KODAK
SAFETY