Human Generated Data

Title

Untitled (Pickaway Livestock Cooperative Association, central Ohio)
Date

July 1938-August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2180
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Pickaway Livestock Cooperative Association, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2180

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
People 99.1
Person 98.7
Person 98.4
Boy 98.4
Male 98.4
Teen 98.4
Person 98.1
Male 98.1
Adult 98.1
Man 98.1
Person 97.6
Person 97.1
Male 97.1
Adult 97.1
Man 97.1
Person 97
Person 96.6
Male 96.6
Adult 96.6
Man 96.6
Person 96
Male 96
Adult 96
Man 96
Face 96
Head 96
Person 95.4
Child 95.4
Female 95.4
Girl 95.4
Person 94.8
Adult 94.8
Female 94.8
Bride 94.8
Wedding 94.8
Woman 94.8
Cap 94.8
Person 87.5
Person 86.8
Person 85.7
Crowd 84.1
Person 81.3
Person 65.3
Hat 61.3
Sun Hat 57.9
Indoors 57.1
Architecture 56.6
Building 56.6
Hospital 56.6
Accessories 56.4
Photography 56.1
Portrait 56.1
Audience 56
Coat 55.8
Pub 55.6
Baseball Cap 55.2

Clarifai
created on 2018-05-10

people 100
group 99.4
group together 97.4
adult 97.1
many 96.6
child 96.4
man 95.2
woman 95.2
administration 93
war 91.4
several 90.6
military 89.6
sit 84.8
recreation 84.5
boy 83.3
leader 82.7
room 82.2
furniture 78.2
wear 78.2
family 77.2

Imagga
created on 2023-10-06

man 34.9
family 33.8
home 32.7
male 32.4
people 31.2
happy 28.8
child 28.6
person 25.9
senior 25.3
couple 25.3
together 22.8
grandfather 22.3
smiling 21
happiness 20.4
old 20.2
adult 19.4
indoors 19.3
love 18.9
father 18.9
mother 18.8
lifestyle 18.8
smile 18.5
elderly 18.2
military uniform 18
kid 16.8
boy 16.5
playing 16.4
clothing 16
uniform 15.7
daughter 15.4
husband 15.3
parent 14.4
portrait 14.2
sitting 13.7
retired 13.6
two 13.6
wife 13.3
men 12.9
face 12.8
retirement 12.5
son 12.5
married 12.5
little 12.4
togetherness 12.3
cheerful 12.2
mature 12.1
fun 12
casual 11.9
grandmother 11.7
room 11
children 10.9
childhood 10.7
world 10.7
interior 10.6
hairdresser 10.6
loving 10.5
barbershop 10.2
kin 10.1
blond 10.1
leisure 10
aged 10
couch 9.7
day 9.4
expression 9.4
innocent 9.1
dress 9
pensioner 8.9
older 8.7
laughing 8.5
relationship 8.4
house 8.4
active 8.3
shop 8.2
lady 8.1
women 7.9
grandchild 7.9
play 7.8
adults 7.6
pair 7.6
consumer goods 7.5
holding 7.4
care 7.4
covering 7.4
emotion 7.4
20s 7.3
indoor 7.3
food 7.2
dad 7.2
looking 7.2
kitchen 7.2
baby 7.2
chair 7.1

Google
created on 2018-05-10

photograph 95.9
black and white 88
snapshot 81.8
monochrome photography 73.7
vintage clothing 70.7
family 65.4
monochrome 60.7
stock photography 56.9
human behavior 50.9

Microsoft
created on 2018-05-10

person 99.3
group 81.3
old 76.1
people 69.7
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 91.1%
Sad 66.9%
Fear 27.1%
Calm 22.1%
Surprised 11.7%
Angry 5.7%
Confused 4.1%
Disgusted 1.3%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 96.1%
Surprised 7.8%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 35-43
Gender Male, 62.5%
Calm 69.9%
Happy 21.7%
Surprised 6.8%
Fear 5.9%
Confused 5.4%
Sad 2.3%
Disgusted 1.2%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.5%
Confused 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 18-24
Gender Male, 99.5%
Calm 71.7%
Sad 20.9%
Angry 7.4%
Surprised 6.9%
Fear 6.2%
Disgusted 0.7%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 96.6%
Happy 46.3%
Confused 27.1%
Disgusted 10.4%
Surprised 9.5%
Fear 7.6%
Calm 3.1%
Sad 2.7%
Angry 2.1%

AWS Rekognition

Age 21-29
Gender Female, 83.5%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Disgusted 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 94.4%
Surprised 6.3%
Fear 5.9%
Happy 4.3%
Sad 2.3%
Angry 0.4%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.5%
Calm 80.5%
Angry 16.4%
Surprised 6.4%
Fear 5.9%
Sad 2.8%
Confused 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 52-60
Gender Male, 93.7%
Calm 62.2%
Fear 27.8%
Surprised 6.8%
Sad 4.3%
Happy 1.6%
Confused 1.4%
Disgusted 0.9%
Angry 0.7%

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Boy
Male
Teen
Adult
Man
Child
Female
Girl
Bride
Woman
Hat
Person 98.7%
Person 98.4%
Person 98.1%
Person 97.6%
Person 97.1%
Person 97%
Person 96.6%
Person 96%
Person 95.4%
Person 94.8%
Person 87.5%
Person 86.8%
Person 85.7%
Person 81.3%
Person 65.3%
Boy 98.4%
Male 98.4%
Male 98.1%
Male 97.1%
Male 96.6%
Male 96%
Teen 98.4%
Adult 98.1%
Adult 97.1%
Adult 96.6%
Adult 96%
Adult 94.8%
Man 98.1%
Man 97.1%
Man 96.6%
Man 96%
Child 95.4%
Female 95.4%
Female 94.8%
Girl 95.4%
Bride 94.8%
Woman 94.8%
Hat 61.3%

Categories

Imagga

paintings art 35.6%
pets animals 31.9%
people portraits 30.8%