Human Generated Data

Title

Untitled (four men and a woman sitting at restaurant counter, waiter serving a bowl of soup)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4570
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men and a woman sitting at restaurant counter, waiter serving a bowl of soup)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.8
Person 99.8
Person 99.6
Person 99.3
Person 99.2
Person 98.8
Workshop 98.2
Person 97.4
Person 96.9
Restaurant 86.3
Clinic 75.9
Worker 75.3
Cafeteria 74.4
Apparel 72.6
Clothing 72.6
People 67.4
Room 66.1
Indoors 66.1
Building 64.1
Shop 59.5
Furniture 59.4
Crowd 58.7
Chair 58
Lab 56.8
Cafe 56.3
Pub 55.6

Imagga
created on 2021-12-14

barbershop 84.1
shop 76.5
mercantile establishment 55.6
place of business 37.1
man 34.3
people 30.1
male 24.1
patient 23.4
person 23
hospital 21.8
indoors 20.2
adult 19.6
work 18.8
medical 18.5
establishment 18.2
men 18
room 15.9
doctor 15
medicine 15
business 14.6
working 14.1
senior 13.1
professional 13.1
clinic 13.1
restaurant 12.6
health 12.5
office 12.2
chair 11.8
building 11.7
smiling 11.6
lifestyle 11.6
interior 11.5
illness 11.4
bed 11.4
old 11.1
inside 11
occupation 11
team 10.7
equipment 10.7
table 10.4
women 10.3
happy 10
care 9.9
portrait 9.7
life 9.5
teamwork 9.3
barber chair 9.2
horizontal 9.2
city 9.1
holding 9.1
nurse 9
technology 8.9
businessman 8.8
salon 8.8
couple 8.7
architecture 8.6
smile 8.5
industry 8.5
worker 8.4
mature 8.4
transportation 8.1
computer 8
sitting 7.7
sick 7.7
uniform 7.7
casual 7.6
talking 7.6
adults 7.6
seat 7.4
black 7.2
family 7.1
love 7.1
job 7.1
day 7.1
travel 7

Google
created on 2021-12-14

Photograph 94.2
Black 89.6
Hat 86.3
Black-and-white 85.4
Style 83.8
Customer 78.4
T-shirt 75.5
Snapshot 74.3
Monochrome photography 74
Monochrome 73
Room 69.7
Event 68.1
Retail 67.1
Service 65.8
Job 64
Street 63.9
Sun hat 63.7
Stock photography 62.3
Cap 60.6
Illustration 57.3

Microsoft
created on 2021-12-14

person 98.8
text 98.5
clothing 95.7
man 92.6
indoor 91.9
bottle 77
black and white 60.6
shop 8.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Male, 71.4%
Calm 76%
Surprised 10.4%
Happy 7%
Sad 4.4%
Confused 2%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 70.5%
Calm 87%
Angry 5%
Happy 3.7%
Surprised 1.7%
Confused 1.3%
Sad 1.1%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 25-39
Gender Female, 75.3%
Calm 98.3%
Sad 1%
Happy 0.5%
Surprised 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 34-50
Gender Male, 79%
Happy 50.3%
Calm 45.4%
Sad 2.6%
Angry 0.6%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 58%

Captions

Microsoft

a group of people standing in front of a refrigerator 65.7%
a group of people in front of a refrigerator 64%
a group of people standing on top of a refrigerator 57.9%

Text analysis

Amazon

SODAS
CHOCOLATE
SUNDAES
119323
14323
MADE

Google

323.
SODAS SUNDAS IN 323.
SUNDAS
IN
SODAS