Human Generated Data

Title

Untitled (soda fountain counter, after ice cream contest)

Date

1947

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18333

Human Generated Data

Title

Untitled (soda fountain counter, after ice cream contest)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 99.2
Human 99.2
Restaurant 98.2
Person 98.1
Person 96.4
Person 93.6
Food 92.7
Meal 92.7
Cafe 92.2
Person 91.3
Person 83.3
Person 81.5
Worker 75.2
Face 70.9
Cafeteria 69.6
Pub 65.5
Person 64.4
Sitting 58.5
Clothing 58.5
Apparel 58.5
Hairdresser 57.8
Food Court 57.1
People 56.5
Dish 56.1
Bar Counter 55.7

Imagga
created on 2022-03-04

barbershop 63.2
shop 52.9
salon 44.3
mercantile establishment 39
people 28.4
place of business 26.5
chair 26
man 25.5
table 20.8
business 20
interior 19.4
sitting 18
hairdresser 17.5
indoors 16.7
person 16.6
work 16.5
restaurant 15.9
male 15.6
room 15.4
working 14.1
furniture 14.1
lifestyle 13.7
indoor 13.7
adult 13.7
computer 13.6
women 13.4
modern 13.3
establishment 13.3
men 12.9
inside 12.9
office 12.5
worker 12.3
together 12.3
group 12.1
businessman 10.6
casual 10.2
two 10.2
smiling 10.1
happy 10
equipment 9.8
counter 9.8
job 9.7
home 9.6
building 9.5
industry 9.4
glass 9.3
seat 9.3
house 9.2
barber chair 9.1
technology 8.9
light 8.7
happiness 8.6
architecture 8.6
meeting 8.5
floor 8.4
teamwork 8.3
holding 8.2
businesswoman 8.2
team 8.1
old 7.7
businesspeople 7.6
sit 7.6
communication 7.6
desk 7.6
style 7.4
window 7.3
black 7.2
looking 7.2
classroom 7.2
smile 7.1
portrait 7.1

Google
created on 2022-03-04

Black-and-white 84.9
Style 83.9
Plant 79.6
Barware 77.1
Cooking 76.8
Monochrome 72.9
Monochrome photography 72.8
Event 71.2
T-shirt 70.5
Machine 69.7
Factory 68.3
Art 67.9
Hat 66.2
Room 64.4
Eyewear 63.1
Retail 58.1
Customer 56.1
Metal 51.1
Street 51
Picture frame 50.4

Microsoft
created on 2022-03-04

black and white 90
text 87.4
person 86.5
piano 73.7
clothing 66.7
cooking 20.1

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 99%
Calm 86.9%
Surprised 4.8%
Happy 4.1%
Sad 2%
Disgusted 0.8%
Confused 0.7%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Confused 33%
Calm 27.2%
Angry 15.2%
Sad 9.2%
Surprised 6.8%
Disgusted 4.9%
Fear 3.1%
Happy 0.6%

AWS Rekognition

Age 27-37
Gender Male, 73.9%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Disgusted 0%
Confused 0%
Fear 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 50-58
Gender Female, 50.8%
Calm 95.1%
Happy 4.1%
Confused 0.2%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 13-21
Gender Male, 99.6%
Surprised 41.4%
Calm 27.3%
Sad 14.1%
Confused 5.3%
Angry 4.2%
Disgusted 4.2%
Fear 2.8%
Happy 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people in a kitchen 70.7%
a group of people sitting at a table 54.3%
a group of women cooking in a kitchen 54.2%

Text analysis

Amazon

CHILD
ES
Movia
15
Sweetheart
Movia Lia
STERFLELD
BEOK
Lia
KODAK-SEETA
СПЕБ
KODAK-
beetheart
CALI

Google

CHILD
Movie
IES
Li
EREE
EREE Movie Li CHILD IES