Human Generated Data

Title

Juan Perez with Daughter, Pablo, MO
Date

2002
People

Artist: Andrea Modica, American born 1961
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.178.3
Copyright

© Andrea Modica

Human Generated Data

Title

Juan Perez with Daughter, Pablo, MO

People

Artist: Andrea Modica, American born 1961

Date

2002

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 100
Apparel 100
Chair 99.8
Furniture 99.8
Shorts 99.7
Human 99.4
Person 99.4
Person 97.7
Footwear 97.7
Shoe 97.3
Shoe 96.8
Sandal 74.7
Sitting 73.2
Face 64.6
Boy 64.4
Portrait 63.2
Photo 63.2
Photography 63.2
Door 58.1
Shoe 51.3

Clarifai
created on 2018-02-09

people 99.6
child 98.7
man 97.8
adult 96.8
woman 96.5
portrait 95.2
two 94.6
recreation 93
wear 92.7
family 92.4
boy 92.2
sit 91.7
retro 88.9
one 86.4
adolescent 85.5
sitting 84.9
facial expression 83.2
nostalgia 83
son 80.1
three 79.9

Imagga
created on 2018-02-09

tricycle 100
vehicle 83
conveyance 58.2
man 26.2
people 25.6
male 20.6
outdoors 20.1
sport 19.3
outdoor 17.6
men 17.2
active 14.4
person 13.6
activity 13.4
silhouette 13.2
walking 12.3
adult 12.3
city 11.6
lifestyle 11.6
park 11.5
walk 11.4
fun 11.2
bicycle 11.1
day 11
exercise 10.9
child 10.9
summer 10.3
happy 10
snow 9.9
wheelchair 9.9
sunset 9.9
recreation 9.9
boy 9.6
women 9.5
cold 9.5
adults 9.5
smiling 9.4
sports 9.2
field 9.2
leisure 9.1
bicycle-built-for-two 9.1
sky 8.9
businessman 8.8
outside 8.6
lifestyles 8.5
winter 8.5
black 8.4
portrait 8.4
street 8.3
care 8.2
playing 8.2
danger 8.2
chair 8
job 8
urban 7.9
play 7.8
sitting 7.7
wheel 7.5
action 7.4
alone 7.3
teenager 7.3
business 7.3
sun 7.2
building 7.2
team 7.2
game 7.1
mountain 7.1
family 7.1
ball 7.1

Google
created on 2018-02-09

photograph 96.3
white 96
black 95.3
black and white 93.6
sitting 93.5
monochrome photography 84.6
photography 82
snapshot 81.8
standing 80.4
human behavior 79.2
monochrome 73.1
product 68.9
human 68.8
design 66.8
shoe 62.7
angle 56.7
gentleman 54.7
stock photography 52.1
chair 51.4

Microsoft
created on 2018-02-09

person 94

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 100%
Happy 0.3%
Surprised 0.9%
Disgusted 0.5%
Sad 7.5%
Angry 2.8%
Confused 3.9%
Calm 84.1%

AWS Rekognition

Age 4-7
Gender Male, 69.6%
Sad 3.7%
Disgusted 2.3%
Confused 5.8%
Surprised 4%
Happy 9.7%
Angry 57.6%
Calm 17%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 97.3%

Captions

Microsoft

a group of people posing for the camera 79.8%
a group of people posing for a photo 74.2%
a group of people posing for a picture 74.1%