Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2937
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2937

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Path 100
Sidewalk 100
Clothing 100
Shorts 100
Boy 99.6
Child 99.6
Male 99.6
Person 99.6
City 99.5
Road 99.5
Street 99.5
Urban 99.5
Male 99.4
Person 99.4
Adult 99.4
Man 99.4
Boy 99.4
Child 99.4
Male 99.4
Person 99.4
Skirt 97.3
Footwear 95.7
Shoe 95.7
Shoe 95.3
Walking 94.5
Shoe 91.8
Face 90.3
Head 90.3
Shoe 90.1
Shoe 85.9
Shoe 75.5
Coat 57.6
Accessories 55.9
Boot 55.5

Clarifai
created on 2018-05-10

people 99.9
child 99
adult 97.7
group together 97.7
group 97.3
two 96.9
man 95
boy 94.7
war 93.9
administration 93.5
wear 93.4
military 92.6
four 91.9
woman 91.9
three 91.6
one 89.4
several 88.2
five 87.9
vehicle 86.2
offspring 83.4

Imagga
created on 2023-10-06

walking 34.1
child 30.5
people 29
man 27.6
beach 26.1
walk 23.8
person 20.7
couple 18.3
male 18.1
family 16.9
city 16.6
sand 16.6
street 16.6
sunset 16.2
ocean 15.8
water 15.4
outdoor 15.3
summer 14.1
vacation 13.9
boy 13.9
men 13.7
lifestyle 13.7
silhouette 13.3
kin 13.2
adult 13
parent 12.8
life 12.5
father 12.5
together 12.3
mother 11.8
world 11.8
love 11.1
sidewalk 11
sea 10.9
dad 10.8
travel 10.6
human 10.5
sun 10.5
black 10.4
sky 10.2
happy 10
outdoors 9.9
pedestrian 9.8
old 9.8
women 9.5
shore 9.3
relax 9.3
holding 9.1
juvenile 8.9
legs 8.5
dark 8.4
back 8.3
danger 8.2
coast 8.1
group 8.1
kid 8
urban 7.9
active 7.8
tourist 7.8
portrait 7.8
daughter 7.6
dusk 7.6
senior 7.5
waves 7.4
tourism 7.4
girls 7.3
protection 7.3
grandfather 7.2
wet 7.2
smile 7.1
happiness 7.1

Google
created on 2018-05-10

photograph 96.3
people 95.8
standing 95
black and white 91.3
child 88.2
monochrome photography 84.2
sitting 81.9
snapshot 81.8
photography 80.6
human behavior 79.9
vintage clothing 72.9
monochrome 68.7
human 68
stock photography 56.6
family 55.9
recreation 52.9

Microsoft
created on 2018-05-10

outdoor 99.8
ground 99
person 98.9
posing 60.7
way 42.5
sidewalk 32

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 99.8%
Happy 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.3%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 4-12
Gender Female, 100%
Happy 98.7%
Surprised 6.4%
Fear 6.1%
Sad 2.2%
Calm 0.3%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 6-12
Gender Female, 92.1%
Calm 84.4%
Happy 9.4%
Fear 7.1%
Surprised 6.9%
Sad 2.4%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Boy 99.6%
Child 99.6%
Male 99.6%
Person 99.6%
Adult 99.4%
Man 99.4%
Shoe 95.7%