Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8519

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.9
Person 99.9
Person 99.8
Person 99.8
Apparel 99.7
Clothing 99.7
Person 99.6
Person 99.4
Person 99.2
Person 96.4
Shorts 96.4
Person 94.9
Female 88.8
Face 86.2
Dress 84
Overcoat 81.7
Coat 81.7
Suit 81.7
Advertisement 79
Poster 79
People 78.2
Sleeve 75.5
Woman 74.3
Outdoors 71.5
Girl 67.4
Child 58.6
Kid 58.6
Shirt 58.4
Nature 57.8
Paper 56
Brochure 56
Flyer 56
Countryside 56
Long Sleeve 55.3

Imagga
created on 2022-01-09

people 33.4
person 31
male 30.6
couple 30.5
man 29.5
teacher 28.2
happy 27.5
adult 24.2
happiness 21.1
love 20.5
portrait 20
smiling 19.5
smile 17.8
senior 17.8
together 17.5
women 17.4
men 17.2
bride 16.3
group 16.1
two 15.2
groom 14.8
wedding 14.7
married 14.4
husband 13.5
family 13.3
attractive 13.3
educator 12.9
sexy 12.8
cheerful 12.2
room 11.9
girls 11.8
blackboard 11.6
lifestyle 11.6
child 11.5
indoors 11.4
marriage 11.4
hand 11.4
human 11.2
sitting 11.2
dress 10.8
clothing 10.7
wife 10.4
school 10.4
looking 10.4
sibling 10.1
blond 10
professional 9.9
holding 9.9
old 9.7
lady 9.7
home 9.6
hands 9.5
enjoying 9.5
pair 9.4
casual 9.3
joy 9.2
pretty 9.1
classroom 9
fun 9
outdoors 8.9
handsome 8.9
romantic 8.9
student 8.9
teaching 8.8
older 8.7
retired 8.7
class 8.7
education 8.6
retirement 8.6
elderly 8.6
friends 8.4
mature 8.4
fashion 8.3
board 8.1
team 8.1
romance 8
hair 7.9
60s 7.8
black 7.8
model 7.8
nurse 7.8
modern 7.7
drinking 7.6
loving 7.6
bouquet 7.5
horizontal 7.5
drink 7.5
friendship 7.5
spectator 7.4
new 7.3
suit 7.2
dancer 7.1
face 7.1
businessman 7.1

Google
created on 2022-01-09

Smile 93.2
Style 83.8
Black-and-white 83.6
Shorts 82.2
Adaptation 79.3
Suit 74.2
Monochrome 74
Monochrome photography 73.9
Vintage clothing 73.6
Event 72.6
Crew 71.8
Font 70.7
Photo caption 66.3
Eyewear 66.2
Hat 64.9
T-shirt 64.3
Stock photography 63.5
Team 60.8
History 60.2
Room 59.6

Microsoft
created on 2022-01-09

person 99.7
clothing 97.9
man 93.7
text 89.6
smile 83.9
human face 81.5
group 80.9
dance 80.5
standing 76.5
crowd 0.8

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 90.2%
Calm 99.8%
Happy 0.1%
Surprised 0%
Sad 0%
Angry 0%
Fear 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 40-48
Gender Male, 92.1%
Calm 85.5%
Surprised 12.2%
Happy 1.6%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.6%
Calm 87.3%
Surprised 6.2%
Happy 2.2%
Confused 1.5%
Sad 0.9%
Disgusted 0.8%
Fear 0.7%
Angry 0.5%

AWS Rekognition

Age 25-35
Gender Female, 93.3%
Calm 40.8%
Happy 23.9%
Surprised 18.8%
Sad 11.7%
Disgusted 1.9%
Angry 1.8%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Calm 97.6%
Happy 0.7%
Surprised 0.5%
Sad 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 96.2%
Calm 95.7%
Sad 2%
Happy 1.2%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 80.6%
Calm 91.1%
Sad 8.6%
Happy 0.2%
Angry 0%
Fear 0%
Disgusted 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 26-36
Gender Male, 86.7%
Calm 88.4%
Sad 3.8%
Surprised 2.6%
Fear 1.9%
Confused 1.1%
Angry 0.8%
Happy 0.7%
Disgusted 0.7%

AWS Rekognition

Age 28-38
Gender Male, 95%
Calm 97.4%
Happy 0.9%
Sad 0.8%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 93.7%
Calm 63.3%
Disgusted 18.8%
Sad 11.2%
Confused 1.6%
Surprised 1.5%
Angry 1.4%
Fear 1.3%
Happy 0.9%

AWS Rekognition

Age 27-37
Gender Male, 50.7%
Calm 95.2%
Happy 4.1%
Sad 0.2%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people posing for the camera 92.4%
a group of people posing for a picture 92.3%
a group of people posing for a photo 89.1%

Text analysis

Amazon

17329.
MAGON
DE

Google

17329.
01329.
01329. 17329.