Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: Cooking Class
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3270.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: Cooking Class

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3270.1

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Classroom 99.7
Room 99.7
School 99.7
Indoors 99.7
Person 99.6
Human 99.6
Person 99.6
Person 99.2
Person 99.2
Person 99.1
Person 99
Person 98.4
Person 98.3
Person 98

Clarifai
created on 2025-01-10

people 100
group 99.6
group together 99.1
adult 97.4
child 97.3
woman 97.2
boy 96.8
many 95.6
man 94.9
teacher 93.9
room 92.9
uniform 90.7
education 86.7
several 86.2
elementary school 85.7
administration 85.3
furniture 85
wear 83.6
school 82.7
war 81.1

Imagga
created on 2022-07-02

man 38.3
room 36.3
male 31.2
classroom 29.4
people 27.9
person 27.4
businessman 24.7
business 23.7
musical instrument 23.1
office 21.3
adult 18.5
couple 18.3
men 17.2
indoors 16.7
teacher 16.4
table 15.6
sitting 15.5
meeting 15.1
women 15
happy 14.4
senior 14
smiling 13.7
stringed instrument 13.6
group 12.9
home 12.8
cheerful 12.2
mature 12.1
love 11.8
happiness 11.7
student 11.7
colleagues 11.7
team 11.6
family 11.6
interior 11.5
talking 11.4
businesspeople 11.4
together 11.4
desk 11.3
corporate 11.2
work 11
discussion 10.7
handsome 10.7
professional 10.6
wind instrument 10.6
indoor 10
smile 10
grandfather 9.8
portrait 9.7
looking 9.6
education 9.5
lifestyle 9.4
casual 9.3
two 9.3
communication 9.2
executive 9.2
horizontal 9.2
percussion instrument 9.2
businesswoman 9.1
old 9.1
suit 9
worker 9
computer 8.8
chair 8.8
black 8.4
manager 8.4
working 7.9
day 7.8
conversation 7.8
marimba 7.8
couch 7.7
adults 7.6
school 7.5
holding 7.4
laptop 7.4
phone 7.4
inside 7.4
bowed stringed instrument 7.4
20s 7.3
color 7.2
dress 7.2
sax 7.2
history 7.2
educator 7.1

Google
created on 2022-07-02

Table 90.1
Chair 77.3
Vintage clothing 74.7
Writing desk 70.2
Art 69.7
Room 68.3
Event 67
History 65.5
Uniform 64.7
Classic 63.9
Desk 61.1
Visual arts 56.5
Collection 54.7
Rectangle 53.2
Retro style 52.3

Microsoft
created on 2022-07-02

clothing 98.5
person 98.3
furniture 95.6
table 94.5
old 86.8
man 77.5
text 76.5
chair 59.1
people 55.7
photograph 51.7
woman 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 72.5%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 98.9%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 97.8%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 1.1%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 98.6%
Calm 87.3%
Surprised 11.2%
Fear 6.6%
Sad 2.4%
Angry 0.9%
Happy 0.8%
Confused 0.7%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Female, 99.3%
Calm 94.4%
Surprised 6.8%
Fear 6%
Sad 2.4%
Happy 1.7%
Confused 0.8%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 18-26
Gender Female, 98.8%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 99%
Surprised 90.8%
Fear 12.8%
Happy 10.4%
Calm 9.5%
Angry 5.3%
Sad 2.7%
Disgusted 1.4%
Confused 1%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%
Person 99.6%
Person 99.2%
Person 99.2%
Person 99.1%
Person 99%
Person 98.4%
Person 98.3%
Person 98%

Categories

Imagga

paintings art 92.5%
streetview architecture 3.5%
text visuals 2.1%
interior objects 1.5%

Text analysis

Amazon

2
SNR 2
SNR

Google

othe us
othe
us