Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8511

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.7
Person 99.7
Person 99.7
Person 99.5
Person 99.5
Person 99.4
Apparel 97.9
Clothing 97.9
Person 96.7
Person 96
Person 95.9
Shorts 84.8
Crowd 84.5
Person 84.3
People 71.9
Face 70.9
Food 65.3
Meal 65.3
Sleeve 65
Female 64.6
Coat 61.7
Overcoat 61.7
Portrait 61.3
Photography 61.3
Photo 61.3
Suit 60.6
Audience 57

Imagga
created on 2022-01-09

people 32.3
man 30.2
person 28.7
male 27.7
senior 24.3
happy 23.2
smiling 21.7
adult 21.6
couple 20.9
teacher 20.3
child 18.8
nurse 17.5
men 17.2
together 16.6
elderly 16.3
family 16
women 15
love 15
portrait 14.9
happiness 14.1
patient 14.1
group 13.7
retired 13.6
home 13.5
husband 13.3
old 13.2
retirement 12.5
mature 12.1
cap 11.9
day 11.8
school 11.5
married 11.5
medical 11.5
indoors 11.4
smile 11.4
student 11.3
education 11.2
camera 11.1
casual 11
room 10.9
professional 10.7
human 10.5
mother 10.2
lifestyle 10.1
sibling 10
classroom 9.9
70s 9.8
health 9.7
wife 9.5
enjoying 9.5
sitting 9.4
headdress 9.3
two 9.3
blackboard 9.1
holding 9.1
team 8.9
outdoors 8.9
daughter 8.9
60s 8.8
educator 8.8
older 8.7
class 8.7
grandfather 8.6
clothing 8.5
togetherness 8.5
hand 8.3
hospital 8.3
emotion 8.3
fun 8.2
cheerful 8.1
looking 8
seniors 7.8
couples 7.8
youth 7.7
father 7.6
world 7.6
joy 7.5
spectator 7.5
friendship 7.5
shower cap 7.5
leisure 7.5
kin 7.4
care 7.4
indoor 7.3
girls 7.3
black 7.2
childhood 7.2
modern 7

Google
created on 2022-01-09

Photograph 94.2
Hat 82.6
Shorts 82.6
Adaptation 79.3
Sleeve 77
Font 76.7
T-shirt 75.3
Snapshot 74.3
Crew 73.7
Event 72.5
Photo caption 70.4
Vintage clothing 70.2
Monochrome photography 66.9
Monochrome 66.3
Stock photography 64.7
Team 64.3
History 64
Suit 62.2
Room 58.3
Uniform 58.2

Microsoft
created on 2022-01-09

person 99.2
text 97
clothing 96.5
man 94.9
human face 75.9
smile 66.1
crowd 0.9

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 83.8%
Calm 93.5%
Sad 4.9%
Happy 1%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 87%
Happy 97.4%
Surprised 1%
Calm 0.7%
Sad 0.5%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 45-51
Gender Female, 53.4%
Happy 96.9%
Surprised 1.5%
Calm 0.5%
Fear 0.4%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%
Sad 0.2%

AWS Rekognition

Age 27-37
Gender Female, 52.3%
Calm 90.3%
Happy 4.2%
Surprised 4.1%
Sad 0.4%
Disgusted 0.4%
Confused 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 84.6%
Happy 73.5%
Fear 10.8%
Sad 8.9%
Surprised 4.4%
Calm 0.8%
Confused 0.6%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Female, 93.3%
Happy 98.6%
Fear 0.5%
Sad 0.4%
Surprised 0.2%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Male, 81.5%
Calm 88.9%
Fear 3.7%
Happy 2.2%
Sad 1.8%
Surprised 1.7%
Disgusted 0.8%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Male, 98.2%
Calm 91.7%
Fear 7.3%
Happy 0.4%
Disgusted 0.3%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 94.8%
Calm 99.2%
Happy 0.3%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for the camera 86.7%
a group of people posing for a photo 82.6%
a group of people posing for a picture 82.5%

Text analysis

Amazon

17327.
KODAK

Google

17327.
11327.
17327. 11327.