Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8513

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.8
Human 99.8
Person 99.7
Person 99.3
Person 98.6
Person 98
Apparel 96.6
Clothing 96.6
Person 96.1
Food 86.2
Meal 86.2
Person 80.9
Face 79.5
Dish 76
Skin 72.2
People 71.7
Female 67.1
Shorts 66.5
Crowd 62.8
Outdoors 60.8
Furniture 60.3
Nature 60.1
Finger 60
Bed 59.5
Coat 57.6
Suit 57.6
Overcoat 57.6

Imagga
created on 2022-01-09

man 36.3
people 35.7
senior 34.7
person 33.9
male 32.8
couple 27.9
happy 25.1
home 23.9
adult 23.6
smiling 23.1
men 22.3
indoors 21.1
family 20.4
together 20.1
happiness 19.6
mature 19.5
retirement 18.2
elderly 18.2
teacher 18.1
kin 16.6
retired 16.5
old 16
room 15.7
portrait 15.5
husband 15.3
cheerful 14.6
sitting 14.6
women 14.2
love 14.2
lifestyle 13.7
group 13.7
nurse 13.5
child 13.3
patient 12.9
grandfather 12.8
70s 12.8
classroom 12.7
older 12.6
holding 12.4
60s 11.7
blackboard 11.7
married 11.5
smile 11.4
wife 11.4
enjoying 11.4
professional 11.2
camera 11.1
student 10.8
businessman 10.6
brass 10
team 9.8
medical 9.7
pensioner 9.6
drinking 9.6
world 9.6
talking 9.5
meeting 9.4
friends 9.4
friendship 9.4
alcohol 9.2
inside 9.2
drink 9.2
20s 9.2
business 9.1
mother 9
to 8.8
caring 8.8
casual clothing 8.8
40s 8.8
two people 8.7
table 8.6
day 8.6
school 8.5
musical instrument 8.5
casual 8.5
hand 8.4
leisure 8.3
wind instrument 8.3
father 8.2
hospital 8.1
new 8.1
parent 8
job 8
nursing home 7.9
seniors 7.9
hands 7.8
black 7.8
class 7.7
health 7.6
illness 7.6
two 7.6
life 7.6
females 7.6
laughing 7.6
joy 7.5
relaxed 7.5
enjoyment 7.5
human 7.5
relationship 7.5
care 7.4
occupation 7.3
indoor 7.3
businesswoman 7.3
aged 7.2
looking 7.2
worker 7.2
face 7.1
modern 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.5
clothing 98.9
man 95.1
smile 90.9
text 89.6
human face 87.1

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 97.1%
Happy 81.8%
Calm 16%
Confused 0.6%
Sad 0.4%
Disgusted 0.4%
Angry 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 61.2%
Calm 93.9%
Sad 3.7%
Happy 0.7%
Surprised 0.6%
Angry 0.4%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Female, 71.7%
Happy 96.6%
Calm 2.6%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Female, 65.2%
Happy 47%
Sad 27.9%
Calm 23.7%
Disgusted 0.4%
Fear 0.3%
Confused 0.3%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 19-27
Gender Female, 56.6%
Happy 91.9%
Calm 4.4%
Sad 1.8%
Fear 1.3%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 81.4%
Happy 87.5%
Sad 3.8%
Surprised 3.3%
Calm 2.8%
Angry 0.9%
Disgusted 0.8%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Female, 50.7%
Calm 89.8%
Happy 5.1%
Sad 2.9%
Surprised 0.8%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 95.2%
Calm 99%
Sad 0.6%
Happy 0.4%
Disgusted 0%
Angry 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 75.5%
Calm 42.2%
Fear 27.8%
Sad 10.6%
Happy 9%
Surprised 3.8%
Angry 2.7%
Confused 2.3%
Disgusted 1.6%

AWS Rekognition

Age 24-34
Gender Male, 96.2%
Calm 83.2%
Surprised 13.1%
Happy 0.9%
Angry 0.8%
Confused 0.7%
Sad 0.6%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 52-60
Gender Male, 94.5%
Calm 98.5%
Happy 0.7%
Fear 0.3%
Sad 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 24-34
Gender Male, 90.4%
Calm 85.6%
Disgusted 8.2%
Happy 2%
Fear 1.8%
Sad 0.6%
Surprised 0.6%
Confused 0.6%
Angry 0.6%

AWS Rekognition

Age 22-30
Gender Female, 81.2%
Calm 75.7%
Happy 12.3%
Sad 2.9%
Disgusted 2.4%
Fear 2.3%
Angry 1.7%
Confused 1.4%
Surprised 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for the camera 90.3%
a group of people standing in front of a window 81.5%
a group of people posing for a picture 81.4%

Text analysis

Amazon

17328
17328.
ITELAR

Google

17328.
17328. 11328.
11328.