Human Generated Data

Title

Untitled (two graduates in cap and gown receiving diplomas)
Date

1948
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2967

Human Generated Data

Title

Untitled (two graduates in cap and gown receiving diplomas)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Stage 99.1
Person 97.2
Human 97.2
Crowd 94.9
Person 94.8
Person 94.6
Person 90.5
Person 90.5
Person 89.5
Person 82.2
Musician 81.9
Musical Instrument 81.9
Person 79.1
Person 78.5
Person 73.8
Person 72.6
Audience 72.6
Apparel 71.4
Clothing 71.4
Person 67.5
Person 65.8
Music Band 63.9
People 62
Officer 57
Military Uniform 57
Military 57

Imagga
created on 2022-01-21

stage 56.5
platform 44.1
people 31.8
person 31.7
man 31
male 28.3
group 26.6
classroom 25.6
room 23.8
teacher 20.3
men 19.7
education 19
businessman 18.5
business 18.2
school 16.7
student 16.6
adult 16.6
happy 16.3
smiling 14.5
team 14.3
office 13.9
table 13.8
musical instrument 13.4
worker 13.4
percussion instrument 13.2
meeting 13.2
blackboard 13.1
professional 13
marimba 12.9
hand 12.9
work 12.5
crowd 12.5
executive 12.4
silhouette 12.4
job 12.4
smile 12.1
corporate 12
black 12
women 11.8
board 11.7
class 11.6
desk 11.3
teamwork 11.1
concert 10.7
portrait 10.3
indoor 10
cheerful 9.7
human 9.7
teaching 9.7
couple 9.6
hands 9.5
lifestyle 9.4
modern 9.1
confident 9.1
holding 9.1
interior 8.8
working 8.8
symbol 8.7
boy 8.7
partner 8.7
musical 8.6
businesspeople 8.5
child 8.4
design 8.4
study 8.4
manager 8.4
fun 8.2
music 8.2
children 8.2
businesswoman 8.2
player 8.1
success 8
musician 8
speaker 8
home 8
to 8
flag 7.9
happiness 7.8
students 7.8
audience 7.8
sitting 7.7
diversity 7.7
performance 7.6
chair 7.6
sign 7.5
hall 7.5
lights 7.4
competition 7.3
successful 7.3
playing 7.3
girls 7.3
new 7.3
indoors 7

Google
created on 2022-01-21

Font 79
Suit 76.8
Art 75.5
Stage equipment 72.8
Event 71.9
Team 68.5
Vintage clothing 67.9
Musical instrument 66.9
Monochrome 66.5
Crowd 66.4
Uniform 66.1
Machine 64.6
Monochrome photography 64.3
Advertising 63.9
Room 62.6
Curtain 59
Entertainment 57.8
Illustration 53.9
Crew 53.9
Display device 53.6

Microsoft
created on 2022-01-21

person 86.6
man 73.2
clothing 66.4
white 62
old 50.6

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 99.5%
Sad 94%
Calm 3.4%
Disgusted 0.7%
Confused 0.7%
Fear 0.4%
Happy 0.4%
Angry 0.3%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Male, 97.8%
Confused 39.1%
Sad 36.2%
Fear 11.9%
Calm 5.2%
Angry 3.6%
Disgusted 2%
Surprised 1.5%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a group of people standing in front of a crowd 83.1%
a person standing in front of a crowd 83%
a group of people standing in front of a crowd of people 80.9%

Text analysis

Google

レ
レ