Human Generated Data

Title

Untitled (wedding guests seated on folding chairs)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10678
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests seated on folding chairs)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.2
Human 99.2
Person 98.6
Person 97.2
Person 96.8
Person 96.5
Person 93.2
Clothing 90.5
Apparel 90.5
Tie 84.7
Accessories 84.7
Accessory 84.7
Clinic 83.2
Person 80.5
Furniture 80.2
Sleeve 70.6
People 69.2
Chair 68.1
Sunglasses 67.9
Crowd 64.3
Photography 63
Photo 63
Portrait 62.1
Face 62.1
Female 61.1
Suit 60
Coat 60
Overcoat 60
Bed 58.5
Indoors 57.8
Hospital 56.6
Room 56.2

Imagga
created on 2022-01-15

man 44.3
newspaper 44.2
people 35.7
male 34.1
person 33.2
senior 31.9
product 31.9
indoors 28.1
room 27.6
adult 25.4
creation 24.9
home 24.7
smiling 22.4
sitting 21.5
happy 19.4
classroom 19.2
teacher 18.4
businessman 17.7
couple 17.4
men 17.2
portrait 16.8
together 16.6
patient 16.6
office 16.5
business 16.4
elderly 16.3
camera 15.7
retired 15.5
old 15.3
working 15
mature 14.9
professional 14.8
education 14.7
casual 14.4
group 13.7
retirement 13.4
nurse 13.3
lifestyle 13
computer 12.8
colleagues 12.6
team 12.5
30s 12.5
medical 12.4
talking 12.4
businesspeople 12.3
meeting 12.2
20s 11.9
student 11.9
day 11.8
40s 11.7
color 11.7
class 11.6
hospital 11.5
desk 11.3
women 11.1
inside 11
work 11
businesswoman 10.9
70s 10.8
casual clothing 10.8
60s 10.7
two people 10.7
cheerful 10.6
barbershop 10.6
table 10.4
clinic 10.3
teamwork 10.2
horizontal 10
indoor 10
smile 10
face 9.9
pensioner 9.9
teaching 9.7
to 9.7
health 9.7
older 9.7
daily 9.5
happiness 9.4
doctor 9.4
laptop 9.1
worker 9.1
educator 8.9
discussing 8.8
coworkers 8.8
looking 8.8
discussion 8.8
mother 8.7
illness 8.6
shop 8.4
holding 8.3
school 8.1
interior 8
seniors 7.9
sixties 7.8
50s 7.8
middle aged 7.8
thirties 7.8
mid adult 7.7
daytime 7.7
modern 7.7
angle 7.7
college 7.6
enjoying 7.6
females 7.6
relaxed 7.5
screen 7.5
care 7.4
occupation 7.3
aged 7.2
world 7.2
family 7.1
job 7.1

Google
created on 2022-01-15

Human 89.1
Black-and-white 83.3
Adaptation 79.3
Table 77
Chair 75.3
Monochrome 74.6
Monochrome photography 74.3
Font 73.8
Event 72.5
Room 71.5
Vintage clothing 69.5
Art 68
Sleeve 64
Photo caption 63.3
History 62.9
Sitting 62.6
Stock photography 61.7
Hat 58.6
Tablecloth 56.7
Pattern 54.7

Microsoft
created on 2022-01-15

text 96.7
person 95.5
clothing 90.3
woman 63.2

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 89.6%
Calm 95%
Happy 2.1%
Sad 1.3%
Surprised 0.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 85.3%
Sad 65.2%
Calm 18.4%
Confused 9.7%
Happy 2.8%
Fear 1.4%
Disgusted 1%
Angry 0.7%
Surprised 0.7%

AWS Rekognition

Age 50-58
Gender Male, 99%
Calm 94.7%
Sad 2.7%
Angry 0.6%
Surprised 0.6%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Female, 60.3%
Calm 96.4%
Sad 1.5%
Confused 0.6%
Fear 0.5%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 49-57
Gender Female, 98.9%
Happy 52.9%
Calm 27.5%
Sad 11.4%
Confused 4%
Angry 1.6%
Disgusted 1%
Surprised 0.8%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 84.7%
Sunglasses 67.9%

Captions

Microsoft

a group of people standing next to a window 74.3%
a group of people standing in front of a window 71.9%
a group of people standing in a room 71.8%

Text analysis

Amazon

21
21 307
307
21307.
2

Google

21307. 108 21 307'
21307.
108
21
307'