Human Generated Data

Title

Untitled (group of young adults in riding outfits having tea)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5187

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of young adults in riding outfits having tea)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clinic 99.4
Person 98.8
Human 98.8
Person 98
Person 97.9
Operating Theatre 97.3
Hospital 97.3
Person 97
Person 95.8
Doctor 76.3
Person 74.7
Apparel 63.2
Clothing 63.2
Hat 63.2
Surgery 55.2
Indoors 55.2
Room 55.2

Imagga
created on 2022-01-23

person 45.2
man 37
adult 35.3
people 32.9
office 31.6
computer 30.5
male 30.5
businessman 30
professional 29
business 28.5
businesspeople 26.6
laptop 25.6
work 25.2
working 24.7
patient 24.6
businesswoman 24.5
happy 24.4
sitting 24
desk 23
indoors 22.8
room 22.6
smiling 22.4
home 21.5
worker 21.5
indoor 19.2
job 18.6
nurse 18.4
corporate 18
men 18
casual 17.8
colleagues 17.5
meeting 17
lifestyle 16.6
technology 16.3
group 16.1
executive 16
teamwork 15.8
face 15.6
women 15
table 14.9
team 14.3
life 14.3
communication 14.3
smile 14.3
portrait 14.2
occupation 13.7
modern 13.3
doctor 13.2
together 13.1
teacher 13
looking 12.8
associates 12.8
day 12.6
medical 12.4
talking 12.4
couple 12.2
cheerful 12.2
hand 12.2
education 12.1
case 11.8
coworkers 11.8
happiness 11.8
color 11.7
mid adult 11.6
sick person 11.5
bright 11.4
specialist 11.4
groom 11.3
manager 11.2
hospital 11.2
health 11.1
20s 11
horizontal 10.9
crew 10.8
handsome 10.7
interior 10.6
medicine 10.6
clinic 10.5
house 10
jacket 9.8
student 9.5
career 9.5
keyboard 9.4
successful 9.2
confident 9.1
holding 9.1
human 9
explaining 8.9
25 30 years 8.8
businessperson 8.8
40s 8.8
busy 8.7
30s 8.7
sofa 8.6
workplace 8.6
expression 8.5
attractive 8.4
clothing 8.3
coat 8.3
care 8.2
chair 8.1
suit 8.1
product 8
to 8
conference 7.8
lab 7.8
cooperation 7.7
test 7.7
pretty 7.7
uniform 7.7
boss 7.7
females 7.6
sit 7.6
senior 7.5
leisure 7.5
alone 7.3
lady 7.3
success 7.2
employee 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99
wedding dress 92.9
bride 85.4
person 85.1
window 82.9
woman 72.7
clothing 68
wedding 66.5

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 92.3%
Calm 53.4%
Happy 39.3%
Sad 2.9%
Confused 2.5%
Surprised 0.9%
Disgusted 0.6%
Angry 0.4%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 55.7%
Calm 99.9%
Sad 0%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Male, 60.3%
Sad 81.8%
Calm 11.5%
Happy 2.8%
Confused 1.2%
Angry 1%
Surprised 0.8%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 34-42
Gender Female, 97.3%
Calm 96.5%
Sad 1.4%
Happy 1.1%
Confused 0.6%
Disgusted 0.3%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 86.3%
Calm 93.6%
Surprised 2.7%
Fear 1.9%
Disgusted 0.9%
Confused 0.3%
Happy 0.3%
Sad 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Hat 63.2%

Captions

Microsoft

a group of people sitting at a table 70.9%
a group of people sitting at a table in front of a book 47.6%
a group of people sitting around a table 47.5%

Text analysis

Amazon

32.
115. 32.
115.
11532.
RODVK

Google

115
115 32. 1532.
32.
1532.