Human Generated Data

Title

Untitled (children with birthday hats sitting around a table)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4907

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children with birthday hats sitting around a table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 97.4
Person 96.8
Clothing 95.2
Helmet 95.2
Apparel 95.2
Person 94
Furniture 92.5
Meal 91.2
Food 91.2
Person 90.9
Room 90.3
Indoors 90.3
Table 89.6
Dining Table 89.6
Person 87.9
Person 87.8
Dish 86.3
People 70.8
Dining Room 67.3
Text 58.8
Drawing 56.2
Art 56.2
Crowd 55.7
Person 54.4

Imagga
created on 2022-01-23

iron lung 96.7
respirator 77.2
breathing device 58.2
device 40.1
man 26.9
male 26.2
people 24.5
person 22
work 22
business 21.8
adult 20.5
room 20.1
laptop 19.5
businessman 19.4
computer 18.5
technology 16.3
men 15.4
working 15
modern 14.7
office 14.6
job 14.1
happy 13.8
table 13.7
desk 13.3
smiling 13
home 12.7
team 12.5
building 12.2
meeting 12.2
group 12.1
together 11.4
senior 11.2
worker 10.7
indoors 10.5
couple 10.4
old 10.4
executive 10.4
education 10.4
sitting 10.3
student 10.2
teamwork 10.2
businesswoman 10
school 9.9
classroom 9.8
human 9.7
discussion 9.7
portrait 9.7
class 9.6
professional 9.4
doctor 9.4
blackboard 9.2
teacher 9.2
new 8.9
engineer 8.9
medical 8.8
client 8.8
looking 8.8
conference 8.8
construction 8.5
plan 8.5
writing 8.5
manager 8.4
patient 8.1
interior 7.9
medicine 7.9
women 7.9
design 7.9
architecture 7.8
equipment 7.8
designer 7.7
hospital 7.5
holding 7.4
occupation 7.3
smile 7.1

Google
created on 2022-01-23

Black 89.6
Table 88.9
Black-and-white 83.9
Style 83.8
Chair 79.5
Monochrome photography 75.1
Monochrome 73.1
Event 69
Design 68.3
Room 66.2
History 65.5
Pattern 65.3
Rectangle 64.8
Stock photography 63.5
Font 60.5
Military uniform 54.7
Art 53.3

Microsoft
created on 2022-01-23

text 99.5
person 90.4
window 84.9
black and white 84.2
group 66.7
drawing 63.5
old 47.1
several 10.3

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 83.3%
Happy 60.9%
Calm 19.3%
Sad 7.8%
Surprised 4.1%
Confused 2.9%
Angry 2.3%
Disgusted 1.4%
Fear 1.3%

AWS Rekognition

Age 37-45
Gender Male, 92.2%
Happy 89.2%
Calm 6.5%
Sad 1.5%
Surprised 1%
Fear 0.6%
Angry 0.6%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 40-48
Gender Male, 96.4%
Calm 45.3%
Sad 29.4%
Confused 7.8%
Happy 5.7%
Surprised 5.3%
Angry 2.9%
Disgusted 2.5%
Fear 1.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 98.6%
Sad 0.5%
Confused 0.4%
Surprised 0.3%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 95.2%

Captions

Microsoft

a group of people around each other 74.3%
a group of people in an old photo of a person 66.3%
a group of people standing next to a window 59.2%

Text analysis

Amazon

Happy
Happy Birthday
Birthday
ة
A2
17842
TE
A2 ИАМТЕАЗ
17842.
ИАМТЕАЗ
So
S

Google

I7842. 17842.
I7842.
17842.