Human Generated Data

Title

Untitled (large group of little boys and girls on stage for Tom Thumb wedding)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3555

Human Generated Data

Title

Untitled (large group of little boys and girls on stage for Tom Thumb wedding)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Indoors 98.5
Person 98
Human 98
Room 97.7
Interior Design 97.7
Person 96.9
Person 95.3
Furniture 94.4
Crowd 94.2
Person 92.2
Person 92
Stage 89.3
Audience 88.8
Chair 88.1
Person 82.8
Hall 75.2
Auditorium 74.5
Theater 74.5
Person 74
People 71.7
Person 68
Court 67.3
Person 61.5
Waiting Room 60.3
Reception 60.3
Reception Room 60.3
Table 59.1
Press Conference 58.8
Couch 57.4
Classroom 56.6
School 56.6
Person 49.9

Imagga
created on 2022-01-22

room 80.1
classroom 56.9
interior 56.6
table 43.6
chair 37.3
furniture 36.6
modern 35
house 34.2
indoor 29.2
restaurant 28.5
dining 27.6
home 27.1
design 25.9
decor 24.7
building 24.7
wood 24.2
indoors 23.7
window 23.6
chairs 22.5
kitchen 21.7
luxury 21.4
floor 20.4
inside 20.2
office 20
hall 19.7
glass 19.4
architecture 18.7
light 18
empty 18
contemporary 17.9
style 17.1
structure 16.4
decoration 15.9
dinner 15.1
seat 14.8
comfortable 14.3
food 14
wall 13.8
cabinet 13.8
counter 13.6
apartment 13.4
lamp 13.3
stove 12.8
plant 12.7
nobody 12.4
3d 12.4
library 12
tables 11.8
lighting 11.7
people 11.7
cafeteria 11.7
business 11.5
urban 11.4
stool 10.9
shop 10.8
living 10.4
bar 10.2
elegance 10.1
oven 9.8
steel 9.7
wooden 9.7
residential 9.6
expensive 9.6
sofa 9.6
decorate 9.5
render 9.5
tile 9.5
eat 9.2
city 9.1
stylish 9
drawer 8.9
lunch 8.6
blackboard 8.4
drink 8.3
domestic 8.1
success 8
cabinets 7.9
dining room 7.9
upscale 7.9
refrigerator 7.9
scene 7.8
space 7.8
barbershop 7.7
elegant 7.7
hotel 7.6
mirror 7.6
relaxation 7.5
place 7.4
coffee 7.4
service 7.4
mercantile establishment 7.4
cook 7.3
center 7.3
metal 7.2
lifestyle 7.2
day 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 89.7
window 88.5
text 78.3
white 74.5

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 89.7%
Happy 95.8%
Calm 3.3%
Sad 0.5%
Surprised 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Female, 73.8%
Calm 68.6%
Sad 11.4%
Happy 10.9%
Fear 2.6%
Confused 2.1%
Disgusted 1.9%
Angry 1.4%
Surprised 1%

AWS Rekognition

Age 25-35
Gender Male, 99.2%
Calm 57.8%
Sad 29.6%
Happy 6.7%
Fear 2.7%
Angry 1.7%
Disgusted 0.7%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Male, 86.5%
Calm 72.5%
Sad 12.3%
Surprised 4.8%
Confused 3.7%
Angry 2.2%
Fear 2.1%
Happy 1.5%
Disgusted 1%

AWS Rekognition

Age 25-35
Gender Female, 83.5%
Sad 95%
Calm 2.1%
Fear 1.9%
Confused 0.3%
Happy 0.3%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Female, 61.4%
Calm 93.2%
Sad 2.3%
Happy 2.1%
Disgusted 0.6%
Angry 0.5%
Confused 0.5%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Male, 93.2%
Calm 44.9%
Sad 35.6%
Happy 12%
Surprised 2.4%
Fear 2.1%
Angry 1%
Disgusted 1%
Confused 1%

AWS Rekognition

Age 11-19
Gender Male, 71.1%
Sad 44%
Calm 37.6%
Fear 5.9%
Confused 4.4%
Angry 2.5%
Surprised 2.1%
Disgusted 1.8%
Happy 1.6%

AWS Rekognition

Age 18-26
Gender Male, 99.4%
Calm 65.2%
Sad 27.6%
Happy 2.6%
Angry 1.1%
Fear 1.1%
Surprised 1%
Confused 1%
Disgusted 0.5%

AWS Rekognition

Age 16-22
Gender Male, 71.7%
Calm 48.5%
Sad 42.8%
Confused 3.3%
Angry 1.7%
Fear 1.4%
Happy 1%
Surprised 0.7%
Disgusted 0.7%

AWS Rekognition

Age 16-24
Gender Male, 90%
Happy 32%
Calm 31.3%
Angry 11.6%
Sad 10.7%
Fear 8.7%
Confused 3.2%
Disgusted 1.6%
Surprised 0.8%

AWS Rekognition

Age 20-28
Gender Male, 85.1%
Calm 84.8%
Happy 6.7%
Sad 3.1%
Angry 1.8%
Fear 1.3%
Confused 1%
Disgusted 1%
Surprised 0.4%

AWS Rekognition

Age 13-21
Gender Female, 92.9%
Calm 48.4%
Sad 21.6%
Happy 14.5%
Fear 6.1%
Angry 3.8%
Confused 2.9%
Surprised 1.5%
Disgusted 1.3%

AWS Rekognition

Age 24-34
Gender Male, 89.5%
Calm 94.1%
Sad 2.4%
Surprised 1%
Confused 1%
Happy 0.5%
Angry 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 20-28
Gender Female, 83.4%
Calm 71.2%
Confused 16.6%
Sad 6.9%
Happy 1.8%
Angry 1.3%
Disgusted 1%
Surprised 0.8%
Fear 0.4%

AWS Rekognition

Age 9-17
Gender Male, 95.9%
Calm 32.4%
Happy 23.3%
Sad 15.1%
Fear 10.2%
Confused 9.3%
Disgusted 3.5%
Angry 3.3%
Surprised 3%

AWS Rekognition

Age 18-26
Gender Male, 82.9%
Calm 74.1%
Sad 18.2%
Happy 3.4%
Angry 1.6%
Confused 1.1%
Disgusted 0.7%
Fear 0.6%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%

Captions

Microsoft

a group of people standing in front of a window 76.7%
a crowd of people standing in front of a window 76.6%
a group of people in front of a window 73.9%

Text analysis

Amazon

1
SAFETY