Human Generated Data

Title

Untitled (Harvard University administrators)
Date

1920s
People

Artist: Erich Salomon, German 1886 - 1944
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2776

Human Generated Data

Title

Untitled (Harvard University administrators)

People

Artist: Erich Salomon, German 1886 - 1944

Date

1920s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2776

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Chair 99.9
Furniture 99.9
Person 99.6
Human 99.6
Person 99.5
Sitting 99.4
Person 98.8
Crowd 93.2
Restaurant 89
Tie 84.7
Accessories 84.7
Accessory 84.7
Audience 71.3
People 68.1
Cafe 67.6
Suit 67.2
Clothing 67.2
Coat 67.2
Apparel 67.2
Overcoat 67.2
Pub 67.2
Indoors 66.5
Bar Counter 66.4
Table 65.6
Room 62.4
Portrait 60.9
Face 60.9
Photography 60.9
Photo 60.9
Jury 60
Cafeteria 58.3
Speech 58.2
Couch 57.8
Press Conference 55.2
Court 55
Chair 53.5

Clarifai
created on 2023-10-26

people 99.9
group 99.6
adult 99.2
group together 99
administration 98.8
furniture 98.6
room 97.5
many 97.3
leader 97
several 94.6
man 94.4
woman 94.4
sit 94.3
desk 94.2
chair 92.2
war 87.8
five 87.8
four 87.2
three 83.1
education 82.1

Imagga
created on 2022-01-23

classroom 53.7
room 44.3
man 36.9
people 30.7
male 29.1
person 28.1
adult 22
scholar 20.6
men 20.6
couple 18.3
business 17.6
sitting 17.2
intellectual 16.5
cheerful 16.2
smiling 15.9
musical instrument 15.2
businessman 15
indoors 14.9
office 14.6
education 13.8
table 13.8
happy 13.8
happiness 13.3
restaurant 13.1
student 13
group 12.9
love 12.6
teacher 12.5
home 12
women 11.9
portrait 11.6
handsome 11.6
school 11.4
lifestyle 10.8
holding 10.7
percussion instrument 10.7
family 10.7
together 10.5
old 10.4
adults 10.4
black 10.3
professional 10.3
casual 10.2
indoor 10
smile 10
discussion 9.7
drinking 9.6
standing 9.6
talking 9.5
meeting 9.4
marimba 9
building 8.9
color 8.9
interior 8.8
working 8.8
looking 8.8
colleagues 8.7
corporate 8.6
glass 8.6
college 8.5
chair 8.5
face 8.5
desk 8.5
drink 8.3
20s 8.2
team 8.1
child 7.8
teaching 7.8
businesspeople 7.6
human 7.5
mature 7.4
wine 7.4
work 7.4
businesswoman 7.3
holiday 7.2
job 7.1
stringed instrument 7

Google
created on 2022-01-23

Table 95.7
Photograph 94.2
Furniture 93.2
Chair 90.7
Coat 90.4
Black 89.8
Desk 83.5
Suit 83.2
People 77.8
Classic 76.4
Vintage clothing 74.8
Snapshot 74.3
Monochrome 74.2
Motor vehicle 73.9
Monochrome photography 71.5
Event 70.7
Writing desk 66.5
Recreation 65.5
Room 65
Sitting 64.9

Microsoft
created on 2022-01-23

text 99.7
table 99.2
clothing 95.7
man 94.8
indoor 93.9
person 93.3
furniture 86.6
black 65.7
book 61.2
black and white 60.8
restaurant 58.6
library 53.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Calm 98%
Confused 0.5%
Sad 0.4%
Angry 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 88%
Angry 6.7%
Confused 2.4%
Surprised 1.5%
Sad 0.7%
Fear 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 56-64
Gender Male, 99.4%
Sad 98.7%
Confused 0.7%
Calm 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0%
Happy 0%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair
Person
Tie
Suit
Chair 99.9%
Chair 53.5%
Person 99.6%
Person 99.5%
Person 98.8%
Tie 84.7%
Suit 67.2%

Categories

Imagga

people portraits 81.6%
interior objects 9.9%
food drinks 4.1%
paintings art 1.9%
events parties 1.6%