Human Generated Data

Title

Untitled (children in formal wear on stage, boy and girl approaching ramp)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11230

Human Generated Data

Title

Untitled (children in formal wear on stage, boy and girl approaching ramp)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Crowd 98.9
Human 98.9
Person 98.7
Person 98.5
Audience 98
Person 94.2
Person 94.2
Person 94.1
Person 93.5
Person 91.1
Person 90.6
Indoors 89.9
Chair 87.9
Furniture 87.9
Room 85.6
Person 80.6
Press Conference 80.4
Person 76.7
Person 75.6
Person 72.9
Person 69.9
People 62.9
Person 61.1
Court 60
Hall 57
Stage 57
Person 55.7
Classroom 55
School 55
Person 49.1

Imagga
created on 2022-01-23

classroom 74.7
room 66.4
trombone 31.8
interior 31.8
brass 30.1
wind instrument 29.3
musical instrument 28.2
people 27.3
table 21.6
man 19.5
business 19.4
chair 19.2
modern 18.2
male 17
group 16.9
window 16.8
oboe 16.1
women 15.8
floor 15.8
city 15.8
urban 15.7
furniture 15.4
indoor 14.6
men 14.6
person 14.1
inside 13.8
house 13.4
glass 13.2
indoors 13.2
adult 12.9
home 12.7
hall 12.6
stringed instrument 12.5
architecture 12.5
office 12.2
crowd 11.5
light 11.3
building 11.3
design 11.2
silhouette 10.7
bowed stringed instrument 10.6
businessman 10.6
contemporary 10.3
smiling 10.1
lifestyle 10.1
restaurant 10
teacher 9.9
kitchen 9.8
chairs 9.8
students 9.7
portrait 9.7
equipment 9.5
walk 9.5
dining 9.5
wall 9.4
board 9
decor 8.8
airport 8.8
together 8.7
station 8.7
guitar 8.6
sitting 8.6
empty 8.6
meeting 8.5
study 8.4
wood 8.3
team 8.1
working 7.9
food 7.8
work 7.8
day 7.8
education 7.8
concert 7.8
corporate 7.7
move 7.7
apartment 7.7
walking 7.6
girls 7.3
music 7.3
life 7.3
activity 7.2
job 7.1
steel 7.1
professional 7.1

Google
created on 2022-01-23

Photograph 94.2
Furniture 93.7
White 92.2
Chair 89.8
Black 89.8
Building 86.4
Black-and-white 85.7
Style 84.2
Suit 80.8
Hall 79.1
Decoration 77.8
Monochrome 75.6
Monochrome photography 75.5
Curtain 74.2
Event 73.5
Formal wear 67.7
Conference hall 65.6
Stock photography 63.4
Uniform 63.4
Room 63.1

Microsoft
created on 2022-01-23

person 88.4
text 68.8
white 67.8

Face analysis

Amazon

Google

AWS Rekognition

Age 1-7
Gender Female, 91.8%
Fear 47.3%
Sad 27.5%
Calm 9.1%
Confused 5.8%
Disgusted 3.4%
Surprised 3.2%
Angry 2.2%
Happy 1.5%

AWS Rekognition

Age 6-14
Gender Male, 73%
Calm 54%
Sad 26.7%
Fear 5.1%
Angry 4.8%
Surprised 2.6%
Confused 2.5%
Happy 2.2%
Disgusted 2%

AWS Rekognition

Age 4-10
Gender Male, 90.4%
Fear 41.6%
Calm 37.3%
Angry 6.6%
Surprised 4.9%
Happy 3.2%
Disgusted 2.9%
Sad 2.5%
Confused 1%

AWS Rekognition

Age 9-17
Gender Female, 100%
Happy 95.1%
Sad 2%
Fear 1.6%
Calm 0.8%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Male, 100%
Happy 99.5%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Calm 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 76.5%
Sad 55.5%
Calm 13.4%
Confused 9.8%
Fear 7.9%
Disgusted 4.9%
Surprised 3.2%
Angry 2.9%
Happy 2.4%

AWS Rekognition

Age 18-26
Gender Female, 100%
Sad 46.2%
Calm 17.6%
Disgusted 12.2%
Confused 10.4%
Fear 5.2%
Surprised 3.5%
Angry 3.4%
Happy 1.5%

AWS Rekognition

Age 6-14
Gender Female, 60.8%
Calm 96.6%
Sad 1.4%
Confused 0.6%
Angry 0.6%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 4-12
Gender Male, 98.9%
Calm 71.1%
Fear 22.3%
Sad 3.6%
Angry 0.8%
Disgusted 0.8%
Surprised 0.7%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Female, 98.4%
Calm 60.8%
Fear 19.7%
Sad 7%
Happy 5.1%
Surprised 2.9%
Confused 2.4%
Disgusted 1.2%
Angry 0.9%

AWS Rekognition

Age 2-10
Gender Male, 99.9%
Calm 89.9%
Fear 4.9%
Surprised 3.5%
Confused 0.6%
Angry 0.4%
Disgusted 0.3%
Sad 0.3%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Female, 78.3%
Calm 98.7%
Sad 0.5%
Fear 0.4%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 4-12
Gender Male, 89.8%
Calm 98.1%
Sad 0.8%
Fear 0.4%
Angry 0.2%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 7-17
Gender Male, 90.8%
Happy 97%
Calm 1.3%
Surprised 0.5%
Sad 0.4%
Disgusted 0.4%
Confused 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 2-8
Gender Female, 100%
Happy 99.2%
Angry 0.4%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%
Calm 0%

AWS Rekognition

Age 2-8
Gender Female, 93.1%
Confused 50.5%
Surprised 43.7%
Sad 3.5%
Fear 1.2%
Happy 0.3%
Calm 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-12
Gender Male, 99.1%
Calm 98.7%
Sad 1.1%
Confused 0.1%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 1-7
Gender Female, 98.1%
Calm 58.9%
Sad 34.3%
Confused 2.1%
Fear 1.7%
Disgusted 1.2%
Happy 0.9%
Angry 0.5%
Surprised 0.3%

AWS Rekognition

Age 43-51
Gender Male, 88.6%
Happy 22.8%
Sad 20.7%
Angry 16.7%
Fear 12.8%
Calm 10.4%
Disgusted 9.3%
Confused 4.5%
Surprised 2.7%

AWS Rekognition

Age 6-12
Gender Male, 98.8%
Sad 55.4%
Calm 19.1%
Confused 14.6%
Fear 4%
Surprised 2.9%
Angry 2.3%
Disgusted 1.1%
Happy 0.7%

AWS Rekognition

Age 2-10
Gender Female, 77.8%
Sad 77%
Calm 12%
Fear 5.3%
Angry 2%
Disgusted 1.8%
Happy 0.9%
Confused 0.6%
Surprised 0.6%

AWS Rekognition

Age 7-17
Gender Female, 99.8%
Sad 87.1%
Calm 4.4%
Surprised 2.8%
Angry 1.5%
Disgusted 1.3%
Confused 1.1%
Fear 1.1%
Happy 0.6%

AWS Rekognition

Age 6-14
Gender Female, 54.1%
Sad 31.4%
Fear 23.8%
Confused 14%
Surprised 14%
Calm 11.1%
Disgusted 2.4%
Happy 2.4%
Angry 0.9%

AWS Rekognition

Age 1-7
Gender Female, 96.4%
Surprised 81.4%
Calm 6.9%
Sad 6.2%
Fear 3%
Angry 1.3%
Disgusted 0.6%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 6-16
Gender Male, 90%
Sad 52.5%
Confused 26.1%
Calm 13.3%
Disgusted 2.9%
Angry 2.3%
Fear 2%
Happy 0.6%
Surprised 0.4%

AWS Rekognition

Age 1-7
Gender Male, 99.4%
Calm 53.7%
Happy 29.1%
Sad 11.3%
Confused 2.2%
Fear 1.7%
Angry 0.8%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 4-12
Gender Female, 69.6%
Calm 64.5%
Sad 16.3%
Angry 5.7%
Disgusted 5.2%
Confused 2.8%
Happy 2.5%
Fear 1.7%
Surprised 1.2%

AWS Rekognition

Age 6-14
Gender Female, 60%
Calm 67.5%
Sad 13.3%
Happy 7.3%
Confused 5.1%
Disgusted 2.7%
Angry 2.3%
Surprised 1.1%
Fear 0.7%

AWS Rekognition

Age 4-10
Gender Male, 99.9%
Sad 76%
Calm 22.9%
Confused 0.7%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 6-14
Gender Female, 97.9%
Calm 45.9%
Sad 39.1%
Confused 8%
Disgusted 2.4%
Fear 1.7%
Surprised 1.1%
Happy 0.9%
Angry 0.9%

AWS Rekognition

Age 2-10
Gender Male, 89.5%
Fear 54.4%
Calm 37.7%
Sad 6.3%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 95.4%
Calm 89.7%
Sad 6.2%
Angry 2%
Confused 1.5%
Happy 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 96.7%
Sad 82.2%
Calm 9.3%
Angry 5.6%
Fear 1.1%
Confused 0.6%
Surprised 0.5%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 6-14
Gender Female, 98.7%
Fear 48.1%
Sad 17.7%
Happy 10.7%
Calm 10.2%
Confused 6.4%
Disgusted 2.7%
Angry 2.4%
Surprised 1.8%

AWS Rekognition

Age 6-14
Gender Male, 76.4%
Calm 49.1%
Fear 34.9%
Sad 7.2%
Angry 4.3%
Happy 1.6%
Surprised 1.3%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 16-24
Gender Male, 87.4%
Calm 78.6%
Sad 18%
Disgusted 0.9%
Angry 0.8%
Happy 0.8%
Fear 0.5%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 14-22
Gender Male, 84.4%
Calm 60.8%
Sad 14.7%
Fear 14.5%
Happy 2.8%
Confused 2.6%
Angry 2%
Surprised 1.4%
Disgusted 1.3%

AWS Rekognition

Age 22-30
Gender Female, 88.2%
Fear 97.3%
Sad 2%
Calm 0.3%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 6-14
Gender Male, 98.7%
Calm 98.6%
Sad 0.7%
Happy 0.2%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 2-10
Gender Male, 53.4%
Surprised 55.6%
Fear 31.9%
Calm 5.3%
Confused 5.2%
Disgusted 0.5%
Angry 0.5%
Sad 0.5%
Happy 0.5%

AWS Rekognition

Age 18-26
Gender Female, 92.9%
Sad 43.2%
Calm 34.3%
Confused 7.5%
Angry 7.4%
Disgusted 3.3%
Fear 2%
Surprised 1.3%
Happy 1.2%

AWS Rekognition

Age 19-27
Gender Male, 81.1%
Fear 43.6%
Calm 31.3%
Sad 10.2%
Confused 7.9%
Angry 2.5%
Surprised 1.7%
Happy 1.4%
Disgusted 1.4%

AWS Rekognition

Age 7-17
Gender Male, 85.8%
Happy 56.9%
Surprised 15.7%
Calm 15.3%
Sad 7.2%
Fear 2.2%
Confused 1.2%
Disgusted 0.8%
Angry 0.8%

AWS Rekognition

Age 28-38
Gender Male, 59.5%
Sad 67.8%
Fear 18.3%
Happy 6.4%
Calm 4.2%
Disgusted 1%
Angry 1%
Confused 0.8%
Surprised 0.6%

AWS Rekognition

Age 11-19
Gender Male, 78%
Sad 55%
Angry 17%
Calm 11.8%
Surprised 9%
Fear 2.3%
Disgusted 1.7%
Confused 1.7%
Happy 1.5%

AWS Rekognition

Age 12-20
Gender Female, 73.3%
Calm 36.9%
Surprised 27.1%
Fear 16.8%
Happy 14.6%
Sad 1.6%
Disgusted 1.3%
Angry 1.1%
Confused 0.7%

AWS Rekognition

Age 16-22
Gender Male, 99.7%
Calm 48.8%
Surprised 15.4%
Sad 13.4%
Fear 7%
Disgusted 5.5%
Angry 4.3%
Happy 3.4%
Confused 2.2%

AWS Rekognition

Age 30-40
Gender Female, 96.6%
Fear 85.5%
Calm 8%
Sad 4.4%
Confused 0.8%
Disgusted 0.6%
Surprised 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 11-19
Gender Male, 70.5%
Sad 95.6%
Calm 2.4%
Fear 0.9%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Male, 95.2%
Calm 26.4%
Angry 24.9%
Sad 16.9%
Confused 14.1%
Surprised 5.8%
Happy 5.2%
Disgusted 5.2%
Fear 1.4%

AWS Rekognition

Age 7-17
Gender Female, 99.3%
Sad 94.4%
Fear 3.1%
Disgusted 0.7%
Angry 0.5%
Calm 0.4%
Surprised 0.4%
Confused 0.3%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Chair 87.9%

Captions

Microsoft

a group of people in a room 91%
a group of people standing in a room 88.5%
a group of people standing in front of a building 78.7%