Human Generated Data

Title

Untitled (guests being served at formal dining room table)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8973

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (guests being served at formal dining room table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Clothing 99.5
Apparel 99.5
Person 99.1
Person 98.7
Person 98.2
Person 97.5
Person 97.5
Person 95
Person 94.1
Sunglasses 89.4
Accessories 89.4
Accessory 89.4
Person 89.2
Coat 89.1
Suit 89.1
Overcoat 89.1
Monitor 87.6
Electronics 87.6
Display 87.6
Screen 87.6
Plant 79.2
Blossom 78.2
Flower 78.2
Flower Arrangement 67.9
Flower Bouquet 66.5
TV 58.2
Television 58.2
Person 43.2

Imagga
created on 2022-01-09

man 49.7
male 37.6
people 33.5
person 32.3
senior 31.9
couple 31.3
adult 30.4
happy 23.2
teacher 22.7
businessman 22.1
business 21.2
sitting 20.6
mature 20.4
smiling 20.2
men 19.7
professional 19.4
elderly 18.2
indoors 17.6
team 17
portrait 16.8
home 16.7
old 16.7
together 16.6
group 16.1
meeting 16
life 15.9
kin 15.3
office 15.3
cheerful 13.8
executive 13.7
colleagues 13.6
older 13.6
retired 13.6
educator 13.5
businesspeople 13.3
camera 12.9
women 12.6
happiness 12.5
job 12.4
lifestyle 12.3
education 12.1
table 12.1
smile 12.1
two 11.9
work 11.8
room 11.8
husband 11.4
corporate 11.2
day 11
businesswoman 10.9
handsome 10.7
30s 10.6
patient 10.6
talking 10.4
grandfather 10.4
worker 10.4
love 10.3
teamwork 10.2
aged 9.9
classroom 9.8
to 9.7
40s 9.7
discussion 9.7
busy 9.6
retirement 9.6
four 9.6
wife 9.5
horizontal 9.2
inside 9.2
occupation 9.2
indoor 9.1
world 9.1
holding 9.1
family 8.9
coworkers 8.8
working 8.8
medical 8.8
looking 8.8
grandma 8.8
restaurant 8.7
standing 8.7
student 8.7
married 8.6
drinking 8.6
face 8.5
career 8.5
adults 8.5
desk 8.5
casual 8.5
drink 8.3
20s 8.2
70s 7.9
discussing 7.9
nurse 7.8
casual clothing 7.8
60s 7.8
black 7.8
middle aged 7.8
secretary 7.7
health 7.6
loving 7.6
college 7.6
tie 7.6
enjoying 7.6
communication 7.6
care 7.4
wine 7.4
school 7.3
success 7.2
suit 7.2
interior 7.1

Google
created on 2022-01-09

Photograph 94.1
Black 89.5
Black-and-white 84.5
Plant 83.9
Style 83.8
Art 80.6
Hat 80.3
Adaptation 79.3
People 77.8
Vintage clothing 74.9
Snapshot 74.3
Monochrome photography 73.8
Event 73.3
Monochrome 73.2
T-shirt 71.7
Suit 69.3
Font 66.6
Room 66.6
History 66.5
Team 64.4

Microsoft
created on 2022-01-09

person 99.6
text 88.9
clothing 84.3
human face 70.5
flower 66.2
woman 54.1
crowd 0.9

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 98.5%
Calm 96.5%
Sad 3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%
Angry 0%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 94.7%
Calm 99.8%
Sad 0.1%
Surprised 0%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 80.5%
Surprised 61.2%
Happy 17.1%
Calm 13.4%
Fear 5.7%
Confused 1%
Sad 0.7%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 29-39
Gender Male, 96.7%
Calm 63%
Happy 17.5%
Sad 14.4%
Surprised 1.6%
Confused 1.1%
Angry 1.1%
Disgusted 0.7%
Fear 0.6%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Surprised 87.2%
Confused 5.7%
Sad 3.3%
Calm 1.5%
Disgusted 1%
Fear 0.7%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 60.2%
Sad 15%
Happy 11.1%
Surprised 6.7%
Confused 3.9%
Disgusted 1.2%
Angry 1.1%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Sunglasses 89.4%
Suit 89.1%

Captions

Microsoft

a group of people posing for a photo 94.8%
a group of people posing for the camera 94.7%
a group of people posing for a picture 94.6%

Text analysis

Amazon

10536
YT33A2
M 113 YT33A2
M 113

Google

10536 AVA 10536
AVA
10536