Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5170

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5170

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 100
Clothing 99.9
Shorts 99.9
Person 98.9
Adult 98.9
Male 98.9
Man 98.9
Person 98.5
Person 97.9
Person 97.8
Person 97.6
Adult 97.6
Bride 97.6
Female 97.6
Wedding 97.6
Woman 97.6
Person 97.1
Person 96.6
Person 95.4
Person 95.4
Outdoors 92
Plant 91
Vegetation 91
Person 90.4
Person 89.3
Hat 88.5
Photography 85.5
Person 85.2
Face 84.9
Head 84.9
Portrait 84.9
Nature 82.1
Person 76.8
Tree 64.4
Summer 63.9
Person 63.2
Dress 62.2
Field 57.6
Ball 57.4
Football 57.4
Soccer 57.4
Soccer Ball 57.4
Sport 57.4
Skirt 57.3
Musical Instrument 55.9
Racket 55.7
Tennis 55.7
Tennis Racket 55.7
Garden 55.6
Shirt 55.3

Clarifai
created on 2018-05-10

people 100
child 99.7
group 99.6
group together 99.4
many 97.6
boy 97.5
adult 95.7
man 93.7
offspring 92
education 91.9
recreation 91.7
several 91.5
administration 91.5
school 91.5
wear 90.1
war 90.1
military 88.8
woman 88.6
uniform 88.6
sibling 85.4

Imagga
created on 2023-10-06

uniform 29.1
military 24.1
man 23.5
private 23.2
people 22.3
soldier 19.5
male 19.2
weapon 18.1
person 17.3
military uniform 16.9
kin 16.7
war 16.4
child 16.3
clothing 16
army 15.6
danger 15.5
boy 13.9
travel 13.4
gun 13
sport 12.8
protection 12.7
outdoors 12.1
outdoor 11.5
walk 11.4
together 11.4
men 11.2
camouflage 11
family 10.7
active 10.5
group 10.5
walking 10.4
adult 10.4
helmet 10.2
sports 10.2
beach 10.1
holding 9.9
horse 9.5
rifle 9.2
vacation 9
fun 9
recreation 9
warrior 8.8
happy 8.8
couple 8.7
pedestrian 8.6
mask 8.6
outside 8.6
animal 8.5
old 8.4
tourism 8.2
park 8.2
children 8.2
history 8
kid 8
lifestyle 7.9
combat 7.9
sand 7.9
day 7.8
mother 7.8
conflict 7.8
statue 7.7
extreme 7.7
covering 7.6
consumer goods 7.5
countryside 7.3
girls 7.3
smiling 7.2
summer 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.2
outdoor 96.9
posing 94.1
group 92.9
standing 92
people 71.6
old 54.1
team 37.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-19
Gender Male, 100%
Calm 57.3%
Confused 34.2%
Angry 7.8%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Male, 91.3%
Calm 99.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 97%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 98.8%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 98.3%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 87.6%
Calm 51.8%
Confused 30%
Surprised 10.3%
Fear 7.6%
Sad 2.6%
Disgusted 2.5%
Angry 2.3%
Happy 1.5%

AWS Rekognition

Age 18-24
Gender Female, 62.6%
Calm 97.9%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 1.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Sad 99.8%
Calm 28.8%
Surprised 6.4%
Fear 5.9%
Angry 0.6%
Disgusted 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 94.1%
Surprised 6.5%
Fear 6%
Sad 2.7%
Confused 1.8%
Angry 0.6%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 29-39
Gender Male, 92%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Adult 98.9%
Male 98.9%
Man 98.9%
Bride 97.6%
Female 97.6%
Woman 97.6%

Categories

Imagga

people portraits 90.1%
paintings art 9.7%