Human Generated Data

Title

Untitled (Barong Dance, Bali)
Date

February 2, 1960-February 17, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5248

Human Generated Data

Title

Untitled (Barong Dance, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5248

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.4
Shorts 99.4
Boy 99.2
Child 99.2
Male 99.2
Person 99.2
Person 99.1
Person 99.1
Boy 98.8
Child 98.8
Male 98.8
Person 98.8
People 97.5
Person 96.3
Outdoors 94.9
Person 94.2
Adult 94.2
Female 94.2
Woman 94.2
Person 91.9
Person 86.2
Nature 85.5
Person 76.6
Face 72.5
Head 72.5
Person 67.7
Person 62.9
Adult 62.9
Female 62.9
Woman 62.9
Slum 58
Barefoot 56.1

Clarifai
created on 2018-05-10

people 100
child 99.5
group 99.5
group together 99.1
many 98.2
adult 97.8
several 94.5
boy 93.2
man 92.9
recreation 91.7
offspring 89.6
wear 87.6
war 86.8
woman 86.6
five 86.2
home 85.9
two 84.5
administration 83.1
family 81.9
military 80.3

Imagga
created on 2023-10-06

kin 51.1
child 35.3
beach 28
man 26.2
people 22.3
male 21.4
summer 21.2
sand 18.3
sea 18
love 16.6
newspaper 16.4
mother 16.2
outdoors 16.1
lifestyle 15.9
father 15.7
couple 15.7
happy 15.7
parent 15.6
vacation 15.5
adult 15.5
water 15.3
outdoor 15.3
family 15.1
fun 15
together 14.9
person 14.3
walking 14.2
kid 14.2
happiness 14.1
sky 14
sunny 13.8
sport 13.3
leisure 13.3
dad 13.1
product 13.1
holiday 12.9
men 12.9
musical instrument 12.8
accordion 12
girls 11.8
ocean 11.6
seller 11.6
boy 11.3
sun 11.3
play 11.2
two 11
playing 10.9
children 10.9
joy 10.9
sunset 10.8
life 10.6
creation 10.5
swing 10.3
friends 10.3
outside 10.3
active 10.1
relax 10.1
portrait 9.7
keyboard instrument 9.6
black 9.6
kids 9.4
friendship 9.4
holding 9.1
old 9.1
park 9.1
son 8.9
women 8.7
day 8.6
walk 8.6
youth 8.5
travel 8.4
silhouette 8.3
recreation 8.1
childhood 8.1
wind instrument 8
smiling 8
grass 7.9
smile 7.8
hands 7.8
bench 7.7
tropical 7.7
juvenile 7.6
field 7.5
holidays 7.5
cheerful 7.3
coast 7.2
cute 7.2
sunlight 7.1
little 7.1

Google
created on 2018-05-10

photograph 95.5
black and white 91.8
snapshot 81.8
monochrome photography 80.3
monochrome 70.3
recreation 66.8
history 65.7
child 64.1
human behavior 63.5
tree 52.8
stock photography 52
vehicle 51.2

Microsoft
created on 2018-05-10

outdoor 95.1
old 63.8
vintage 25.6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 87%
Surprised 6.6%
Fear 6%
Sad 5.8%
Confused 2.9%
Happy 0.8%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 4-12
Gender Female, 98.9%
Fear 88.6%
Sad 21.9%
Surprised 6.5%
Calm 5.2%
Angry 2.7%
Happy 1%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 29-39
Gender Male, 87.2%
Calm 90%
Surprised 6.3%
Fear 6%
Happy 4.9%
Sad 3.5%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 19-27
Gender Female, 87.6%
Calm 42.4%
Sad 34.5%
Confused 31.1%
Surprised 6.6%
Fear 6.2%
Angry 1.5%
Happy 0.9%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Male, 78.9%
Sad 99.8%
Calm 23.1%
Surprised 6.8%
Fear 6.4%
Disgusted 2.7%
Angry 0.9%
Happy 0.7%
Confused 0.7%

AWS Rekognition

Age 16-24
Gender Male, 74.4%
Fear 80.5%
Sad 64%
Surprised 6.6%
Calm 3.7%
Disgusted 0.9%
Happy 0.5%
Angry 0.5%
Confused 0.5%

Microsoft Cognitive Services

Age 6
Gender Female

Feature analysis

Amazon

Boy 99.2%
Child 99.2%
Male 99.2%
Person 99.2%
Adult 94.2%
Female 94.2%
Woman 94.2%

Categories

Imagga

streetview architecture 52%
paintings art 36.5%
beaches seaside 8.3%

Captions

Microsoft
created on 2018-05-10

a vintage photo of a boy 85.5%
an old photo of a boy 83.4%
a vintage photo of a child 81.3%