Human Generated Data

Title

Untitled (men gathered around table looking at paper)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8522
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men gathered around table looking at paper)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.8
Human 99.8
Person 99.7
Person 99.3
Person 99.3
Person 99.2
Person 99
Tie 98.4
Accessories 98.4
Accessory 98.4
Person 97.4
Clinic 94.1
Person 92.7
Indoors 78.8
Room 78
Monitor 69.6
Electronics 69.6
Display 69.6
Screen 69.6
Sitting 64.3
People 62.4
Hospital 61.5
Crowd 60.3
Operating Theatre 59.9
Doctor 57.4

Imagga
created on 2022-01-09

executive 52
man 48.4
professional 44.5
office 43.5
male 40.4
businessman 39.7
meeting 38.6
people 37.4
business 36.4
adult 36.2
teacher 35.9
person 35.5
entrepreneur 31.6
sitting 30.1
businesswoman 29.1
group 29
laptop 28.5
happy 28.2
together 28
teamwork 27.8
team 27.8
businesspeople 27.5
table 26.8
computer 26.5
working 26.5
desk 26.4
senior 26.2
smiling 25.3
colleagues 25.3
communication 23.5
corporate 23.2
men 23.2
educator 22.6
room 20.5
worker 20.4
work 19.6
classroom 19.5
job 19.5
secretary 18.6
indoors 18.4
suit 18
confident 17.3
talking 17.1
looking 16
manager 15.8
mature 15.8
couple 15.7
discussion 15.6
smile 15
education 14.7
indoor 14.6
partners 14.6
women 14.2
coworkers 13.8
discussing 13.8
portrait 13.6
home 13.6
successful 12.8
modern 12.6
horizontal 12.6
elderly 12.4
cheerful 12.2
student 12
technology 11.9
collaboration 11.8
cooperation 11.6
handsome 11.6
lifestyle 11.6
workplace 11.4
hand 11.4
success 11.3
keyboard 11.3
happiness 11
employee 10.5
boss 10.5
company 10.2
casual 10.2
associate 9.8
associates 9.8
businessmen 9.8
conversation 9.7
retired 9.7
corporation 9.6
planning 9.6
black 9.6
project 9.6
serious 9.5
friends 9.4
two 9.3
glasses 9.3
interaction 8.9
seminar 8.8
jacket 8.8
40s 8.8
hands 8.7
mid adult 8.7
30s 8.7
retirement 8.6
collar 8.6
staff 8.6
females 8.5
adults 8.5
smart 8.5
showing 8.4
camera 8.3
specialist 8.3
holding 8.3
occupation 8.2
director 8.1
explaining 7.9
appointment 7.8
day 7.8
standing 7.8
60s 7.8
males 7.8
older 7.8
workers 7.8
baron 7.7
employment 7.7
concentration 7.7
class 7.7
busy 7.7
partnership 7.7
four 7.7
old 7.7
formal 7.6
career 7.6
human 7.5
school 7.3
monitor 7.2
face 7.1
to 7.1
paper 7.1

Google
created on 2022-01-09

Shirt 94.7
Hat 89.3
Motor vehicle 81.8
T-shirt 79.6
Event 71.4
Monochrome 70.4
Monochrome photography 70.2
Vintage clothing 67.1
Room 66.4
Font 66
Stock photography 64.6
Crew 64
History 63.8
Cooking 63.3
Photo caption 61.4
Suit 60.3
Team 58
Metal 54.4
Art 53.6
Sitting 51.9

Microsoft
created on 2022-01-09

person 99.6
text 94.8
indoor 89.8
clothing 86.9
man 73.6
black and white 67.1
human face 57.6

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 98.2%
Calm 69.1%
Surprised 20.7%
Confused 3.9%
Sad 2.9%
Disgusted 1.3%
Happy 0.9%
Angry 0.8%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Male, 87.1%
Calm 85.9%
Surprised 4.7%
Happy 2.5%
Angry 2.4%
Confused 2.1%
Sad 1.3%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 48-56
Gender Male, 99.6%
Calm 93.3%
Sad 3.1%
Surprised 1.7%
Angry 0.8%
Disgusted 0.3%
Confused 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 95.3%
Calm 80.8%
Angry 5.8%
Happy 5.5%
Surprised 4.1%
Disgusted 1.6%
Confused 1.3%
Sad 0.6%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Calm 99.5%
Confused 0.2%
Happy 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 73.5%
Sad 78.6%
Calm 20.4%
Happy 0.3%
Confused 0.3%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.5%
Surprised 82.3%
Calm 9.3%
Confused 3.9%
Disgusted 1.9%
Sad 1.1%
Angry 0.6%
Fear 0.6%
Happy 0.4%

AWS Rekognition

Age 33-41
Gender Male, 94.1%
Calm 50.5%
Sad 23.9%
Happy 18.3%
Angry 2.1%
Confused 1.8%
Surprised 1.3%
Fear 1.3%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 98.4%

Captions

Microsoft

a group of people looking at a laptop 84.6%
a group of people sitting at a table 84.5%
a group of people sitting around a table 84.4%

Text analysis

Amazon

17389.
RODYR
EVSIWVM-SVEETA RODYR
EVSIWVM-SVEETA

Google

17389. IT389. IT389. くTココA2
17389.
IT389.
く
T
ココ
A2