Human Generated Data

Title

Untitled (man sitting in tiny racing car)

Date

1960

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16035.2

Human Generated Data

Title

Untitled (man sitting in tiny racing car)

People

Artist: Jack Gould, American

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.7
Human 99.7
Person 99.2
Person 99.1
Person 99.1
Person 99
Person 98.5
Person 96.8
Apparel 92.7
Clothing 92.7
Person 90
Person 89
Shoe 75
Footwear 75
Transportation 64.8
Vehicle 64.4
Person 62.8
Shorts 59.2
Machine 58.1
Spoke 58.1
Clinic 57.7

Imagga
created on 2022-02-11

adult 25.1
person 24.6
people 24
attractive 21.7
happy 20
sitting 19.8
happiness 18.8
male 18.5
man 18.1
pretty 17.5
lady 17
lifestyle 15.9
love 15
couple 14.8
chair 14.4
home 14.3
resort area 14.3
smile 14.2
portrait 13.6
fashion 13.6
interior 13.3
model 13.2
sexy 12
area 12
spectator 11.9
relax 11.8
relaxation 11.7
fun 11.2
luxury 11.1
hair 11.1
smiling 10.9
posing 10.7
human 10.5
outdoors 10.4
dancer 10.3
relaxing 10
leisure 10
performer 9.9
studio 9.9
vacation 9.8
group 9.7
indoors 9.7
style 9.6
child 9.5
men 9.4
outside 9.4
cute 9.3
holiday 9.3
elegance 9.2
seat 9.2
joy 9.2
dress 9
cheerful 8.9
life 8.6
region 8.5
relaxed 8.4
black 8.4
sensuality 8.2
handsome 8
body 8
night 8
dance 7.8
bedroom 7.7
couch 7.7
summer 7.7
youth 7.7
comfortable 7.6
casual 7.6
enjoying 7.6
house 7.5
passenger 7.5
senior 7.5
room 7.5
face 7.1
sofa 7
together 7

Google
created on 2022-02-11

Wheel 88.5
Flash photography 88.2
Happy 83.8
Adaptation 79.3
Hat 78.3
Tire 75.7
Shorts 72.8
Baby 72.8
Event 72.5
Toddler 70.6
Fun 70
T-shirt 69.1
Entertainment 65.9
Lap 65.7
Sitting 65.3
Stock photography 63.1
Baby Products 60.6
Photo caption 59.1
Font 58.5
Conversation 58.4

Microsoft
created on 2022-02-11

person 100
clothing 97.5
outdoor 93.3
man 89.4
footwear 84.2
people 69.9
group 63.1
crowd 2.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 96.4%
Calm 1.7%
Disgusted 0.7%
Angry 0.3%
Surprised 0.3%
Confused 0.3%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 99.7%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Happy 90.9%
Sad 1.9%
Surprised 1.9%
Confused 1.6%
Angry 1.2%
Calm 0.9%
Disgusted 0.8%
Fear 0.8%

AWS Rekognition

Age 13-21
Gender Female, 87.5%
Calm 95.4%
Sad 4.4%
Happy 0.1%
Confused 0%
Fear 0%
Disgusted 0%
Surprised 0%
Angry 0%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 75%

Captions

Microsoft

a group of people sitting posing for the camera 96.1%
a group of people sitting on a bench 88.7%
a group of people posing for the camera 88.6%

Text analysis

Amazon

day
EIFW