Human Generated Data

Title

Untitled (soda fountain counter, before start of ice cream contest)

Date

1947

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18332

Human Generated Data

Title

Untitled (soda fountain counter, before start of ice cream contest)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Human 99
Person 99
Person 98.4
Person 96.3
Person 94.1
Person 93.5
Worker 91.4
Person 80
Building 77.3
Person 72.9
Person 70.1
Face 69.6
People 68.2
Urban 68
Hairdresser 65.8
Person 65.6
Meal 60
Food 60
Girl 59.8
Female 59.8
Pub 59.6
Workshop 59.4
Indoors 58.7
Room 58.7
Town 57.1
City 57.1
Restaurant 56

Imagga
created on 2022-03-04

barbershop 53.3
shop 48.9
mercantile establishment 35.4
percussion instrument 28.8
marimba 28.6
musical instrument 26.4
place of business 23.5
people 23.4
architecture 18.7
window 17.6
city 17.4
building 17.2
chair 17.2
old 16.7
house 15.9
man 15.4
salon 14.2
home 13.5
men 12.9
business 12.7
travel 12.7
interior 12.4
urban 12.2
male 12
sitting 12
restaurant 11.8
adult 11.8
establishment 11.7
indoors 11.4
town 11.1
street 11
historic 11
indoor 10.9
family 10.7
scene 10.4
women 10.3
black 10.2
room 10.1
inside 10.1
life 9.7
windows 9.6
couple 9.6
table 9.5
person 9.5
ancient 9.5
love 9.5
piano 8.9
crowd 8.6
history 8
work 7.9
glass 7.8
mother 7.7
lamp 7.6
stone 7.6
fashion 7.5
outdoors 7.5
counter 7.4
silhouette 7.4
tourism 7.4
portrait 7.1
working 7.1
together 7

Google
created on 2022-03-04

Black-and-white 84.8
Style 83.9
Art 77.9
Motor vehicle 73.7
Machine 73.5
Monochrome photography 73.2
Monochrome 72.2
Engineering 71
Factory 70.3
Cooking 70.2
Room 63.2
Metal 61.4
Toolroom 59.2
Street 57.7
City 53.9
Machine tool 51.7

Microsoft
created on 2022-03-04

black and white 88.3
text 87.3
person 85.7
clothing 55.7

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 98%
Calm 73.1%
Sad 15.2%
Happy 6.4%
Surprised 1.6%
Disgusted 1.3%
Confused 0.9%
Angry 0.7%
Fear 0.7%

AWS Rekognition

Age 51-59
Gender Male, 100%
Happy 82.1%
Calm 13.7%
Disgusted 1.3%
Sad 1.1%
Confused 0.9%
Surprised 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 87%
Confused 5.8%
Surprised 2.2%
Disgusted 1.6%
Sad 1.3%
Fear 1.1%
Angry 0.6%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Male, 100%
Angry 56%
Calm 29.8%
Sad 10.8%
Disgusted 2.4%
Surprised 0.5%
Confused 0.3%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 41-49
Gender Female, 98.6%
Calm 95.7%
Happy 3.6%
Sad 0.4%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Female, 92.4%
Calm 57.7%
Sad 34.6%
Fear 2%
Confused 2%
Surprised 1.1%
Happy 1%
Angry 0.9%
Disgusted 0.7%

AWS Rekognition

Age 13-21
Gender Male, 97.6%
Calm 67%
Sad 15.1%
Disgusted 5.4%
Angry 3.2%
Confused 3%
Surprised 2.9%
Fear 2.5%
Happy 1%

AWS Rekognition

Age 18-24
Gender Female, 95.2%
Surprised 24.2%
Sad 18.7%
Disgusted 13.7%
Confused 12.5%
Calm 9.3%
Fear 9.2%
Angry 7.8%
Happy 4.8%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 42.9%
Confused 29.8%
Happy 12.5%
Sad 7.3%
Disgusted 2.8%
Angry 2.4%
Surprised 1.4%
Fear 0.9%

AWS Rekognition

Age 35-43
Gender Male, 92.6%
Sad 83.8%
Calm 13.1%
Disgusted 0.7%
Happy 0.7%
Confused 0.6%
Angry 0.4%
Fear 0.4%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people sitting at a table 73%
a group of people sitting around a table 72.9%
a group of people sitting at a table in front of a building 72.8%

Text analysis

Amazon

CHILD
Life
AGAIN
Movia Life
weetheart
MOV
CHILD LI
Movia
Sweetheart
agoit
LI
stay
سكة
un

Google

Movie Life CHILD L
Movie
Life
CHILD
L