Human Generated Data

Title

Untitled (man reading score sheet in a bar with a group of men, Pennsylvania)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11663
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man reading score sheet in a bar with a group of men, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.4
Human 99.4
Person 99.3
Person 99.1
Person 98.8
Person 98.7
Person 97.1
Apparel 95.8
Clothing 95.8
Furniture 94.8
Chair 94.8
Musical Instrument 92.4
Leisure Activities 92.4
Piano 92.4
Person 91.3
Person 89.5
Clinic 80.2
Indoors 76.9
Helmet 75.7
Room 71.5
Tie 64
Accessories 64
Accessory 64
Tie 61.2
Photography 60.4
Photo 60.4
People 58.8
Sitting 57.4

Imagga
created on 2022-01-15

teacher 53.7
professional 51.4
adult 42.3
person 40.6
educator 38.6
businessman 38
man 37.6
male 36.9
people 35.1
business 31
office 30.9
corporate 28.4
group 26.6
men 25.8
happy 25.7
businesswoman 25.5
meeting 25.4
businesspeople 24.7
team 24.2
colleagues 23.3
teamwork 22.3
worker 22.1
smiling 21.7
table 20.8
room 20.7
work 19.6
job 19.5
indoors 19.3
executive 19.1
laptop 18.2
sitting 18
modern 17.5
couple 17.4
women 17.4
desk 17
computer 16.9
working 16.8
indoor 16.4
associates 14.8
together 14
coworkers 13.8
conference 13.7
suit 13.6
communication 13.4
happiness 13.3
talking 13.3
cheerful 13
success 12.9
successful 12.8
lab coat 12.7
nurse 12.4
medical 12.4
coat 12.2
mature 12.1
life 11.9
groom 11.7
handsome 11.6
lifestyle 11.6
smile 11.4
doctor 11.3
education 11.3
attractive 11.2
patient 11.2
manager 11.2
casual 11
portrait 11
day 11
discussion 10.7
corporation 10.6
mid adult 10.6
entrepreneur 10.6
color 10.6
career 10.4
presentation 10.2
two 10.2
student 10.1
occupation 10.1
20s 10.1
face 9.9
40s 9.7
new 9.7
clothing 9.7
looking 9.6
home 9.6
horizontal 9.2
pretty 9.1
board 9
explaining 8.9
hospital 8.8
diverse 8.8
classroom 8.8
teaching 8.8
full length 8.7
30s 8.7
diversity 8.7
chair 8.6
fan 8.6
boss 8.6
ethnic 8.6
senior 8.4
company 8.4
technology 8.2
building 7.9
seminar 7.9
colleague 7.8
hands 7.8
businessmen 7.8
cooperation 7.7
busy 7.7
partnership 7.7
staff 7.7
waiter 7.6
adults 7.6
human 7.5
light 7.4
clinic 7.3
confident 7.3
bright 7.2
idea 7.1
love 7.1

Google
created on 2022-01-15

Furniture 93.4
Table 89.9
Black 89.7
Black-and-white 87.2
Coat 85.5
Style 84.1
Chair 81.6
Monochrome photography 76.9
Monochrome 76
Suit 75.4
Snapshot 74.3
Vintage clothing 73.7
Event 73
Art 69.6
Room 69.2
Formal wear 68.9
White-collar worker 68.1
Stock photography 63.8
Classic 62.7
History 62.3

Microsoft
created on 2022-01-15

text 99.1
person 95.3
clothing 90.7
wedding dress 86.7
woman 77.9
standing 77.6
bride 76.8
man 70
posing 66.9
group 58.9
dress 55.6

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Happy 74.2%
Surprised 21.6%
Confused 1%
Angry 0.8%
Sad 0.8%
Calm 0.6%
Fear 0.5%
Disgusted 0.5%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Calm 98.4%
Surprised 1%
Sad 0.3%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 100%
Confused 60.6%
Calm 22.1%
Surprised 7.8%
Sad 4.6%
Disgusted 1.7%
Angry 1.6%
Happy 1.2%
Fear 0.5%

AWS Rekognition

Age 6-14
Gender Male, 96.9%
Calm 46.4%
Sad 43.9%
Disgusted 4.6%
Confused 2.9%
Angry 0.6%
Happy 0.6%
Fear 0.5%
Surprised 0.5%

AWS Rekognition

Age 43-51
Gender Male, 95.7%
Happy 99.2%
Calm 0.5%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%
Sad 0%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Sad 93.9%
Happy 2.3%
Fear 1.3%
Calm 0.7%
Confused 0.6%
Surprised 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 28-38
Gender Male, 98.6%
Calm 53.2%
Sad 19.9%
Confused 13.7%
Fear 4.2%
Surprised 4.1%
Happy 2.5%
Angry 1.3%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 94.8%
Piano 92.4%
Helmet 75.7%
Tie 64%

Captions

Microsoft

a group of people posing for a photo 94.8%
a group of people posing for the camera 94.7%
a group of people posing for a picture 94.6%

Text analysis

Amazon

9539.
MJIR
MJIR YT3RAS AROA
AROA
YT3RAS

Google

9539.
1539. 9539. MJIR YT3RA2 ARJA
YT3RA2
ARJA
1539.
MJIR