Human Generated Data

Title

Really (in honor of Felix Gonzalez-Torres)
Date

2000
People

Artist: Jim Hodges, American born 1957
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, P2003.8.3.B

Human Generated Data

Title

Really (in honor of Felix Gonzalez-Torres)

People

Artist: Jim Hodges, American born 1957

Date

2000

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 99.6
Human 99.6
Shorts 96.7
Clothing 96.7
Apparel 96.7
Person 74.2
Fish 65.6
Animal 65.6
Garden 65.5
Outdoors 65.5
Arbour 63.9
Amusement Park 63.9
Pants 61.7
Theme Park 58.5

Imagga
created on 2022-05-28

people 25.7
sport 22.2
happy 20.7
outdoors 20.7
adult 20.1
outdoor 19.9
man 19.5
outside 18.8
person 18.3
vacation 17.2
pole 17.1
life preserver 16.9
leisure 16.6
happiness 16.4
beach 16.1
summer 16.1
horse 15.8
sea 15.6
float 15.2
lifestyle 15.2
pretty 14.7
device 14.6
fun 14.2
bikini 14.1
model 14
lady 13.8
sunny 13.8
sexy 13.6
portrait 13.6
ocean 13.5
one 13.4
rod 13.4
joy 13.4
smile 12.8
body 12.8
healthy 12.6
support 12.2
active 12
hair 11.9
day 11.8
smiling 11.6
sky 11.5
sand 11.3
water 11.3
brunette 11.3
fashion 11.3
sun 11.3
harness 11.1
exercise 10.9
holiday 10.7
health 10.4
equipment 10.4
rescue equipment 10.2
training 10.2
relaxation 10
travel 9.9
pool 9.6
women 9.5
swing 9.5
child 9.3
relax 9.3
male 9.2
posing 8.9
swimsuit 8.9
equestrian 8.8
resort 8.6
youth 8.5
tropical 8.5
attractive 8.4
clothing 8.3
slim 8.3
human 8.2
relaxing 8.2
fitness 8.1
activity 8.1
cute 7.9
park 7.9
boy 7.8
life 7.8
face 7.8
sitting 7.7
swimming 7.7
paradise 7.5
strength 7.5
city 7.5
girls 7.3
looking 7.2
coast 7.2
mechanical device 7.1

Google
created on 2022-05-28

Shorts 94.1
Green 93.6
People in nature 90.4
Organism 85.9
Gesture 85.3
Tree 84.8
Grass 84.8
Happy 84
Adaptation 79.3
Elbow 78.8
Tints and shades 77.2
Leisure 76.7
board short 75.8
Arecales 74.3
T-shirt 73.2
Electric blue 71.8
Chest 71.3
Human leg 70.1
Recreation 70
Fun 68.2

Microsoft
created on 2022-05-28

fish 84.6
painting 83.1
aquarium 83
animal 80.2
drawing 71.1
cartoon 60.5
text 60.1
person 52.1
arm 14.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Happy 71.5%
Calm 18.6%
Surprised 7%
Fear 6.4%
Sad 2.9%
Angry 2.8%
Disgusted 1.2%
Confused 1.1%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Fish 65.6%

Captions

Microsoft

a person on a horse 65.3%
a person holding an animal 50.5%
a person standing next to a horse 50.4%