Human Generated Data

Title

Untitled (two men stretching on table, man jumping rope)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4932
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men stretching on table, man jumping rope)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 97.3
Person 96.7
Shoe 96.1
Footwear 96.1
Clothing 96.1
Apparel 96.1
Furniture 94.8
Shoe 94.5
Person 90.7
Shoe 78.4
Tie 72.8
Accessories 72.8
Accessory 72.8
Chair 70.7
Person 67.5
Sport 66.8
Sports 66.8
Tabletop 65.7
Dining Table 63
Table 63
People 58.5
Suit 58.2
Coat 58.2
Overcoat 58.2
Leisure Activities 56.8
Person 46.6

Imagga
created on 2022-01-23

person 45.8
dancer 36.3
man 30.9
people 30.7
adult 29.8
performer 28.2
teacher 25.4
male 23.5
professional 23
portrait 22.6
women 22.1
men 21.5
smiling 20.3
entertainer 19.9
happy 18.8
lifestyle 17.3
room 17.1
two 16.9
smile 16.4
educator 16.1
casual 16.1
life 15
sport 14.6
indoors 14.1
holding 14
pretty 14
exercise 13.6
health 13.2
modern 12.6
businessman 12.4
business 12.1
sitting 12
attractive 11.9
black 11.4
lady 11.4
group 11.3
home 11.2
worker 11.1
work 11
happiness 11
human 10.5
talking 10.5
clothing 9.8
office 9.6
couple 9.6
standing 9.6
walking 9.5
corporate 9.4
mature 9.3
training 9.2
face 9.2
businesswoman 9.1
nurse 9.1
planner 9.1
dress 9
interior 8.8
working 8.8
newspaper 8.7
legs 8.5
communication 8.4
fashion 8.3
one 8.2
healthy 8.2
suit 8.1
activity 8.1
sexy 8
light 8
love 7.9
day 7.8
hands 7.8
old 7.7
gym 7.7
equipment 7.5
house 7.5
city 7.5
outdoors 7.5
fit 7.4
cheerful 7.3
success 7.2
fitness 7.2
team 7.2
together 7

Google
created on 2022-01-23

Photograph 94.2
Black 89.6
Black-and-white 86.6
Table 85
Style 84.2
Monochrome 77.7
Monochrome photography 77
Font 75.3
Art 74.7
Happy 74.3
Snapshot 74.3
Desk 73.3
Chair 73.2
Shorts 71.8
Room 69.8
Balance 69.5
Coffee table 66.4
Stock photography 64.5
Advertising 63.3
Child 63.1

Microsoft
created on 2022-01-23

text 99.5
outdoor 89.4
footwear 87.2
person 85.7
clothing 85.1
furniture 80
table 65.5

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Male, 96.8%
Calm 43.9%
Surprised 15.1%
Happy 12.7%
Sad 11.1%
Confused 9.6%
Angry 3.2%
Disgusted 2.9%
Fear 1.6%

AWS Rekognition

Age 31-41
Gender Male, 99.4%
Calm 47.8%
Surprised 17.1%
Confused 10.4%
Sad 8.8%
Disgusted 7.6%
Angry 3.2%
Fear 2.6%
Happy 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 96.1%
Tie 72.8%

Captions

Microsoft

a group of people in a room 90.2%
an old photo of a person 84%
a group of people posing for a photo 75.9%

Text analysis

Amazon

10714.

Google

ELLE
ELLE