Human Generated Data

Title

Untitled (man holding two neckties, Marion Cricket Club, Haverford, Pennsylvania)

Date

1939, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.313

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man holding two neckties, Marion Cricket Club, Haverford, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.1
Human 99.1
Person 98.3
Person 98.1
Person 97.4
Person 97.2
Crowd 97.2
Person 97
Accessories 93.1
Accessory 93.1
Glasses 93.1
Overcoat 90.7
Suit 90.7
Coat 90.7
Apparel 90.7
Clothing 90.7
Press Conference 82.4
Sitting 81.1
Person 76.9
Audience 76.7
Suit 76.5
Suit 75.5
Tie 74.6
Indoors 67.9
Suit 67.6
Room 62.2
Suit 62
Linen 60.5
Home Decor 60.5
Speech 57.2
Person 41.6

Imagga
created on 2022-01-08

meeting 52.8
office 52.2
businessman 52.1
business 51.6
businesswoman 48.2
team 47.5
group 45.1
man 42.3
male 40.4
teamwork 37.1
businesspeople 36.1
corporate 35.2
people 35.2
colleagues 35
men 34.4
executive 33.9
person 30
work 29.8
happy 29.5
smiling 27.5
professional 27.5
staff 26.9
together 23.7
businessmen 23.4
kin 23.3
partners 23.3
manager 23.3
job 23
communication 22.7
coworkers 22.6
table 21.6
suit 21
confident 20.9
sitting 20.6
discussion 20.4
adult 20.3
workplace 20
desk 19.8
partnership 19.2
associates 18.7
conference 18.6
indoors 18.5
smile 17.8
presentation 17.7
working 17.7
successful 17.4
30s 17.3
success 16.9
company 16.7
room 16.5
corporation 16.4
talking 16.2
discussing 15.7
40s 15.6
20s 15.6
cheerful 15.4
standing 14.8
laptop 14.6
worker 14.4
women 14.2
mature 13.9
indoor 13.7
portrait 13.6
busy 13.5
boss 13.4
career 13.3
computer 12.8
modern 12.6
cooperation 12.6
mid adult 12.5
happiness 12.5
diversity 12.5
couple 12.2
diverse 11.7
horizontal 11.7
colleague 11.7
archive 11.6
handsome 11.6
lifestyle 11.6
formal 11.5
executives 10.8
employee 10.8
seminar 10.8
businesswomen 10.8
conversation 10.7
agreement 10.7
partner 10.6
classroom 10.6
occupation 10.1
hall 9.9
boardroom 9.9
building 9.8
leadership 9.6
looking 9.6
four 9.6
ethnic 9.5
females 9.5
senior 9.4
holding 9.1
color 8.9
collaboration 8.9
explaining 8.9
handshake 8.8
jacket 8.8
speaker 8.7
planning 8.7
collar 8.6
confidence 8.6
adults 8.5
casual 8.5
friends 8.5
positive 8.3
friendly 8.2
technology 8.2
center 8
interaction 7.9
30 35 years 7.9
paper 7.8
25 30 years 7.8
contract 7.8
deal 7.8
looking camera 7.7
finance 7.6
plan 7.6
document 7.4
camera 7.4
training 7.4
inside 7.4
clothing 7.3
buddy 7.1
face 7.1
day 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99.8
clothing 96.1
smile 90.6
man 89.9
people 87.2
human face 85
group 84.1
posing 79.1
suit 63.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Happy 99.8%
Fear 0.1%
Surprised 0%
Disgusted 0%
Angry 0%
Sad 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Happy 52.4%
Calm 26.1%
Angry 10.4%
Surprised 2.9%
Fear 2.8%
Sad 2.5%
Disgusted 1.7%
Confused 1.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Happy 97.4%
Angry 0.7%
Fear 0.4%
Surprised 0.4%
Sad 0.3%
Disgusted 0.3%
Calm 0.3%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Happy 99.6%
Calm 0.1%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 45-53
Gender Male, 100%
Happy 99.5%
Surprised 0.2%
Fear 0.1%
Calm 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%
Sad 0%

AWS Rekognition

Age 24-34
Gender Male, 100%
Happy 95.7%
Angry 1.1%
Confused 0.8%
Surprised 0.6%
Calm 0.6%
Disgusted 0.5%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Female, 99.7%
Disgusted 57.6%
Calm 31.9%
Fear 6.7%
Surprised 1.9%
Confused 0.7%
Sad 0.4%
Happy 0.4%
Angry 0.3%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 53
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Glasses 93.1%
Suit 90.7%
Tie 74.6%

Captions

Microsoft

a group of people sitting posing for the camera 99.2%
a group of people posing for a photo 99.1%
a group of people posing for the camera 99%