Human Generated Data

Title

Untitled (wedding guests seated and standing on lawn)
Date

1953
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8755
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests seated and standing on lawn)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.9
Person 99.9
Person 99.4
Apparel 98.5
Clothing 98.5
Person 97.7
Person 96.7
Person 96.6
Person 96
Person 95.4
Person 92.5
Person 91
Person 90.9
Person 89.3
Furniture 89.1
Chair 89.1
Person 88.6
Person 86.3
Shelter 84.1
Rural 84.1
Outdoors 84.1
Countryside 84.1
Building 84.1
Nature 84.1
Person 83.7
People 83.1
Female 81
Person 77.8
Person 77.4
Skirt 73.6
Crowd 72.4
Home Decor 71.7
Person 68.8
Woman 68.2
Girl 59.9
Dress 55.1

Imagga
created on 2022-01-09

steel drum 50.5
percussion instrument 42.9
musical instrument 35.8
hairdresser 25.6
people 24
chair 18.9
man 18.8
city 16.6
room 16.5
interior 15.9
business 15.2
shop 14.8
male 14.2
old 13.2
urban 13.1
cafeteria 13
table 13
life 12.9
work 12.5
restaurant 12.5
lifestyle 12.3
person 12.2
building 11.9
women 11.9
adult 11.4
office 11.2
modern 11.2
home 11.2
men 11.2
travel 10.6
barbershop 10.2
back 10.1
clothing 9.8
fashion 9.8
indoors 9.7
scene 9.5
walking 9.5
smiling 9.4
professional 9.2
outdoors 8.9
two 8.5
floor 8.4
mature 8.4
leisure 8.3
street 8.3
teacher 8.2
family 8
working 7.9
together 7.9
holiday 7.9
smile 7.8
architecture 7.8
portrait 7.8
furniture 7.6
elegance 7.5
horizontal 7.5
house 7.5
happy 7.5
fun 7.5
coffee 7.4
window 7.3
design 7.3
group 7.2
seat 7.2
businessman 7.1

Google
created on 2022-01-09

Footwear 98.1
Vertebrate 92.1
Black-and-white 84.2
Chair 83.2
Monochrome photography 71.6
Event 71.4
Monochrome 68.4
Room 67.9
Crew 66.6
Vintage clothing 66.6
Team 65.4
History 64.2
Musical instrument 64.1
Dance 62.2
Recreation 58.5
Crowd 55.3
Shorts 54.5
Photo caption 54.3
Sitting 52.5
Suit 51.6

Microsoft
created on 2022-01-09

person 99.7
outdoor 93.9
text 88.1
clothing 85.9
black and white 74
chair 69.6
house 68.7
furniture 59.7
people 58.8

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 90.7%
Calm 50.9%
Happy 47.6%
Confused 0.4%
Sad 0.3%
Angry 0.3%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 33-41
Gender Female, 89.8%
Calm 91.9%
Sad 3.3%
Surprised 2.7%
Angry 0.7%
Confused 0.6%
Happy 0.4%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 94.6%
Calm 79.9%
Sad 9.4%
Surprised 5.9%
Fear 2%
Angry 0.8%
Disgusted 0.8%
Happy 0.7%
Confused 0.5%

AWS Rekognition

Age 33-41
Gender Male, 95.4%
Calm 74.5%
Surprised 22.6%
Sad 2.1%
Fear 0.3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 84.4%
Calm 82.2%
Sad 5.1%
Angry 3.5%
Confused 2.8%
Surprised 2.3%
Happy 1.8%
Disgusted 1.5%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.9%
Chair 89.1%

Captions

Microsoft

a group of people standing in front of a building 92.9%
a group of people standing outside of a building 92.8%
a group of people that are standing in front of a building 88.8%

Text analysis

Amazon

38606
app
YТ37A°-

Google

38606
38606