Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1607

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1607

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Person 99.3
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Sun Hat 98.7
Bench 96.9
Furniture 96.9
Footwear 95.7
Shoe 95.7
Shoe 95.6
Coat 95.5
Person 95.3
Shoe 93.6
Shoe 93.5
Shoe 93.4
Shoe 92.6
Shoe 91.7
Shoe 84.9
Shoe 84.8
Shoe 81.4
People 80.9
City 79.6
Face 79.6
Head 79.6
Hat 68.5
Sitting 67.7
Cap 57.7
Neighborhood 56.5
Formal Wear 56.2
Suit 56.2
Urban 55.2

Clarifai
created on 2018-05-11

people 100
group together 99.7
child 99
group 98.6
adult 98
many 97.3
man 96.6
uniform 94.4
military 93.6
war 93.5
boy 92.9
several 90.1
woman 89.2
administration 88.4
soldier 86.9
outfit 86.8
recreation 85.8
wear 84.2
veil 84.2
education 83.8

Imagga
created on 2023-10-06

military uniform 60.1
uniform 48.1
pedestrian 46.6
snow 37.9
clothing 35.8
winter 32.3
street 27.6
cold 25.8
covering 25.6
consumer goods 24.8
people 24
city 21.6
outdoor 21.4
man 20.8
tree 20
park 19.8
landscape 18.6
season 17.9
trees 17.8
walking 17
outdoors 16.8
fun 15
walk 14.3
sport 14.3
travel 14.1
urban 14
forest 13.9
town 13.9
person 13.9
building 13.6
road 13.5
old 13.2
architecture 12.5
sky 12.1
commodity 12
snowy 11.7
hiking 11.5
boy 11.3
snowing 10.8
male 10.7
together 10.5
couple 10.5
outside 10.3
day 10.2
historic 10.1
house 10
active 10
leisure 10
activity 9.8
vacation 9.8
scene 9.5
happy 9.4
countryside 9.1
child 9.1
mountain 8.9
family 8.9
weather 8.9
group 8.9
tourist 8.7
storm 8.7
frozen 8.6
portrait 8.4
mother 8.4
fall 8.1
new 8.1
recreation 8.1
light 8
college 8
lifestyle 7.9
blizzard 7.9
seasonal 7.9
ski 7.8
backpack 7.8
bench 7.8
adult 7.8
covered 7.8
residential 7.7
adventure 7.6
brick 7.5
wood 7.5
row 7.4
mountains 7.4
grass 7.1
happiness 7.1
autumn 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.8
building 99.8
person 94.3
group 78.4
people 71.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 64.1%
Confused 32.9%
Surprised 6.3%
Fear 5.9%
Sad 3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 77.1%
Happy 11.6%
Surprised 7%
Fear 6.2%
Confused 3.4%
Sad 2.9%
Angry 2.3%
Disgusted 1.2%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 82.6%
Sad 14.6%
Surprised 6.3%
Fear 5.9%
Angry 2.5%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Female, 69.2%
Fear 89.7%
Sad 11.3%
Calm 7.7%
Surprised 7.2%
Angry 1.9%
Confused 1.2%
Happy 1%
Disgusted 0.7%

AWS Rekognition

Age 18-24
Gender Female, 92.1%
Calm 69%
Disgusted 12.9%
Surprised 7.5%
Fear 6.2%
Happy 4.8%
Angry 4.7%
Sad 3.3%
Confused 2.4%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%
Shoe 95.7%
Hat 68.5%

Text analysis

Amazon

SHOP