Human Generated Data

Title

Untitled (woman being questioned at customs counter, Maimi International Airport)

Date

1951

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7072

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman being questioned at customs counter, Maimi International Airport)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Person 99.4
Person 99.1
Person 97.1
Furniture 82.4
Apparel 78.3
Clothing 78.3
Sitting 75.6
Female 67.1
People 65.9
Clinic 62.3
Tie 61.6
Accessories 61.6
Accessory 61.6
Couch 57.4

Imagga
created on 2021-12-15

person 41.7
man 40.3
people 32.9
male 32.7
adult 32.2
patient 30.4
indoors 29.9
senior 26.3
professional 24.3
home 23.9
teacher 23.3
sitting 23.2
smiling 22.4
mature 21.4
happy 20.7
computer 20.1
nurse 19.8
room 19.4
medical 18.5
office 18.2
men 18
businessman 17.7
couple 17.4
hospital 17
casual 17
doctor 16.9
day 16.5
business 16.4
elderly 16.3
cheerful 16.3
color 15.6
colleagues 15.5
30s 15.4
educator 15.2
talking 15.2
meeting 15.1
worker 15
working 15
two people 14.6
businesspeople 14.2
together 14
health 13.9
camera 13.9
indoor 13.7
table 13
group 12.9
work 12.9
occupation 12.8
casual clothing 12.7
40s 12.7
mid adult 12.5
portrait 12.3
lifestyle 12.3
education 12.1
teamwork 12.1
women 11.9
laptop 11.8
businesswoman 11.8
happiness 11.8
horizontal 11.7
retirement 11.5
job 11.5
illness 11.4
face 11.4
grandfather 11.3
coat 11.2
clinic 11.2
looking 11.2
coworkers 10.8
team 10.8
care 10.7
sick person 10.7
smile 10.7
retired 10.7
case 10.5
enjoying 10.4
20s 10.1
70s 9.8
salon 9.8
desk 9.4
screen 9.4
clothing 9.3
two 9.3
classroom 9.3
communication 9.2
modern 9.1
holding 9.1
old 9.1
mother 9
associates 8.9
50s 8.8
60s 8.8
daytime 8.7
adults 8.5
technology 8.2
to 8
casual clothes 7.9
explaining 7.9
crew 7.9
bright 7.9
appointment 7.8
good mood 7.8
days 7.8
teaching 7.8
discussion 7.8
middle aged 7.8
older 7.8
lab coat 7.7
concentration 7.7
shop 7.7
females 7.6
learning 7.5
life 7.5
student 7.4
inside 7.4
book 7.3
relaxing 7.3
hairdresser 7.2
interior 7.1
barbershop 7

Google
created on 2021-12-15

Automotive design 85.4
Black-and-white 84.7
Style 84
Snapshot 74.3
Event 72.4
Monochrome photography 72.2
Monochrome 72.2
Cooking 71.8
Vintage clothing 68.5
Table 67.3
Art 66.5
Fashion design 64.5
Hat 63.4
History 61.7
Job 60.5
Room 60.4
Service 59.5
Eyewear 58.3
Employment 57.4
Sitting 57.2

Microsoft
created on 2021-12-15

person 96.8
text 92.3
clothing 91.4
sketch 79.6
drawing 73.2
man 69.6

Face analysis

Amazon

Google

AWS Rekognition

Age 42-60
Gender Male, 64.6%
Calm 52.6%
Sad 44.8%
Confused 0.7%
Angry 0.7%
Surprised 0.5%
Fear 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-38
Gender Male, 96.6%
Sad 68.1%
Calm 25.6%
Confused 1.8%
Happy 1.7%
Fear 1%
Angry 0.8%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 42-60
Gender Male, 59.9%
Calm 77.7%
Happy 17.5%
Sad 3%
Disgusted 0.8%
Confused 0.5%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 61.6%

Captions

Microsoft

a group of people standing in a kitchen 87.8%
a group of people performing on a counter 86%
a group of people in a kitchen 85.9%

Text analysis

Amazon

48
-
18 -
18

Google

48 YT37A2 NAGOX
YT37A2
48
NAGOX