Human Generated Data

Title

Untitled (Denpasar, Bali)
Date

February 2, 1960-February 17, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5236

Human Generated Data

Title

Untitled (Denpasar, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5236

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Advertisement 100
Adult 99
Male 99
Man 99
Person 99
Adult 98.5
Male 98.5
Man 98.5
Person 98.5
People 98.4
Adult 98.1
Person 98.1
Bride 98.1
Female 98.1
Wedding 98.1
Woman 98.1
Person 96.7
Person 96.4
Person 95.5
Face 90.7
Head 90.7
Person 86.4
Person 79.2
Clothing 65.6
Formal Wear 65.6
Suit 65.6
Accessories 63.7
Tie 63.7
Billboard 57.3
Text 55.3

Clarifai
created on 2018-05-10

people 100
group together 99.8
group 99.5
many 98.6
vehicle 97.4
adult 97.2
several 96.5
administration 96.2
leader 95.7
transportation system 94.5
five 92.2
three 90.6
four 89.4
military 89.4
man 89.3
cavalry 88.5
wear 85.8
outfit 83.9
chair 82.7
woman 81.1

Imagga
created on 2023-10-05

structure 22.3
tree 20
old 19.5
billboard 19.5
fence 17.6
landscape 15.6
signboard 15.4
world 14.9
barbershop 14.5
house 14.2
trees 13.3
winter 12.8
sky 12.8
shop 12.7
building 12
snow 11.9
road 11.7
park 11.7
picket fence 11.4
wheeled vehicle 11.2
rural 10.6
outdoors 10.5
cold 10.3
architecture 10.2
street 10.1
dark 10
city 10
farm 9.8
grass 9.5
mercantile establishment 9.3
field 9.2
outdoor 9.2
night 8.9
sun 8.9
graffito 8.8
vehicle 8.8
forest 8.7
scene 8.7
empty 8.6
industry 8.5
barrier 8.5
shopping cart 8.4
vintage 8.3
countryside 8.2
transportation 8.1
season 7.8
grunge 7.7
sign 7.5
handcart 7.5
environment 7.4
transport 7.3
industrial 7.3
male 7.1

Google
created on 2018-05-10

photograph 96.3
black 95
black and white 90.1
history 83
snapshot 81.8
standing 79.1
monochrome photography 76.1
monochrome 66.5
tree 59.2
vintage clothing 58.6
stock photography 56.3
house 51.8
recreation 51.5

Microsoft
created on 2018-05-10

outdoor 97.6
old 76.2
black 66.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Male, 100%
Surprised 34.6%
Confused 28.4%
Calm 23.3%
Fear 19.4%
Sad 2.7%
Disgusted 1.1%
Happy 0.9%
Angry 0.6%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Fear 97.4%
Surprised 8.4%
Sad 2.2%
Calm 0.2%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Surprised 98.9%
Fear 7.3%
Confused 6%
Calm 3.1%
Sad 2.4%
Angry 1.1%
Disgusted 1.1%
Happy 0.3%

AWS Rekognition

Age 18-24
Gender Male, 96.6%
Calm 91.9%
Surprised 6.8%
Fear 6.4%
Sad 3.1%
Angry 1%
Disgusted 0.8%
Happy 0.7%
Confused 0.6%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Bride 98.1%
Female 98.1%
Woman 98.1%
Suit 65.6%
Tie 63.7%

Categories

Imagga

streetview architecture 99.9%

Captions

Microsoft
created on 2018-05-10

an old photo of a person 80.7%
an old photo of a horse 80.6%
a black and white photo of a person 68.9%