Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5178

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5178

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.7
Shorts 99.7
Person 99
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Person 98.6
Person 98.6
Male 98.3
Boy 98.3
Child 98.3
Person 98.3
Person 98.2
Adult 98.2
Bride 98.2
Female 98.2
Wedding 98.2
Woman 98.2
Person 96.8
Hat 87
Outdoors 84.8
Face 82.3
Head 82.3
People 81.3
Bicycle 75.7
Transportation 75.7
Vehicle 75.7
Person 74.3
Cycling 71.2
Sport 71.2
Nature 67
Bag 56.9
Accessories 56.9
Handbag 56.9
Musical Instrument 55.9
Plant 55.9
Vegetation 55.9
Garden 55.4
Photography 55.2
Portrait 55.2

Clarifai
created on 2018-05-10

people 100
child 99.7
group 99.7
group together 99.4
many 98.1
adult 97.9
several 96.3
man 96.2
recreation 95.5
boy 94.6
family 94.4
three 94
offspring 92.9
woman 92.7
five 91.8
four 91.3
sibling 89.2
administration 87.7
vehicle 87.3
two 87.2

Imagga
created on 2023-10-06

kin 36.1
man 28.9
bench 25
mother 24.6
family 23.1
outdoors 22.2
child 22
park bench 21.5
people 21.2
male 20.8
person 20.5
parent 19.8
happy 16.9
adult 16.4
seat 16.3
love 15.8
park 15.6
day 14.9
outdoor 14.5
father 14.5
lifestyle 14.5
portrait 14.2
couple 13.9
together 12.3
smile 12.1
happiness 11.7
musical instrument 11.6
smiling 11.6
daughter 11.5
fun 11.2
home 11.2
son 11
sport 10.8
statue 10.6
dad 10.6
old 10.4
senior 10.3
boy 9.6
sitting 9.4
outside 9.4
two 9.3
mature 9.3
leisure 9.1
wheelchair 8.8
autumn 8.8
married 8.6
sculpture 8.6
wheeled vehicle 8.4
furniture 8.4
black 8.4
garden 8.4
summer 8.4
joy 8.4
city 8.3
care 8.2
girls 8.2
life 8.1
architecture 7.8
pedestrian 7.8
casual 7.6
relax 7.6
relationship 7.5
holding 7.4
children 7.3
building 7.2
holiday 7.2
childhood 7.2
tricycle 7.1
grass 7.1
women 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.6
person 97.4
group 70.1
old 55.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 86.4%
Calm 90.1%
Sad 7.1%
Surprised 6.3%
Fear 5.9%
Angry 0.8%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 34-42
Gender Male, 99.2%
Calm 94.3%
Surprised 6.3%
Fear 5.9%
Sad 4.4%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Female, 83.1%
Calm 95.2%
Surprised 6.3%
Fear 6.2%
Sad 2.8%
Confused 1.3%
Happy 0.4%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Female, 72.8%
Calm 61%
Confused 12.4%
Disgusted 12.3%
Angry 7.1%
Surprised 6.9%
Fear 6.2%
Sad 3.4%
Happy 1.6%

AWS Rekognition

Age 27-37
Gender Female, 99.7%
Calm 58.2%
Fear 15.9%
Surprised 13.2%
Angry 5.3%
Disgusted 4.2%
Happy 3.7%
Sad 2.4%
Confused 1.9%

AWS Rekognition

Age 20-28
Gender Female, 69.5%
Sad 92.8%
Fear 32.2%
Calm 10.2%
Surprised 8.2%
Happy 5.4%
Disgusted 3.1%
Angry 2.3%
Confused 0.6%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Adult 98.8%
Male 98.8%
Man 98.8%
Boy 98.3%
Child 98.3%
Bride 98.2%
Female 98.2%
Woman 98.2%

Categories