Human Generated Data

Title

Portrait of a Man and Two Women

Date

c. 1924-76, printed 2005

People

Artist: Baldomero Alejos, Peruvian 1902-1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the David Rockefeller Center for Latin American Studies, Harvard University, Estrellita Bograd Brodsky Fund for Latin American Art and Culture and Gustavo E. Brillembourg Memorial Fund, 2012.124

Human Generated Data

Title

Portrait of a Man and Two Women

People

Artist: Baldomero Alejos, Peruvian 1902-1976

Date

c. 1924-76, printed 2005

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-28

Human 99.7
Person 99.7
Clothing 99.5
Apparel 99.5
Person 99.4
Accessory 98.1
Tie 98.1
Accessories 98.1
Person 97.5
People 95
Female 94.3
Coat 93
Overcoat 93
Family 89.5
Suit 88.1
Hat 81.8
Woman 81.2
Face 79.6
Photo 68.8
Portrait 68.8
Photography 68.8
Girl 67.3
Painting 64.4
Art 64.4
Tuxedo 59
Man 56.5

Clarifai
created on 2019-05-28

people 100
portrait 99.2
adult 98.7
group 98.5
man 96.2
wear 95.7
administration 95.1
leader 93.8
two 92.8
woman 92.2
music 90.2
three 89.2
outfit 85.5
one 84.7
retro 83.2
child 82.7
actor 82.5
musician 82.2
military 81.6
chair 80.3

Imagga
created on 2019-05-28

man 38.3
person 35.6
suit 33.8
male 33
adult 31.8
portrait 31.1
people 28.5
fashion 25.6
happy 22.6
businessman 22.1
black 21.8
couple 21.8
standing 21.7
attractive 21.7
business 20.7
model 20.2
handsome 19.6
smile 19.2
lifestyle 18.1
smiling 17.4
jacket 17.4
hair 16.7
happiness 16.5
style 16.3
tie 16.1
dark 15.9
confident 15.5
elegant 15.4
pretty 15.4
sexy 15.3
face 14.9
professional 14.6
success 14.5
looking 14.4
brunette 13.9
casual 13.6
dress 13.6
human 13.5
love 13.4
guy 13.1
office 12.9
expression 12.8
posing 12.4
together 12.3
clothing 12.2
studio 12.2
shirt 11.8
pose 11.8
work 11.8
stylish 11.8
holding 11.6
corporate 11.2
brother 10.9
worker 10.7
cheerful 10.6
executive 10.4
men 10.3
women 10.3
room 10.3
two 10.2
actor 10.2
alone 10
hand 9.9
performer 9.8
family 9.8
cool 9.8
serious 9.5
sitting 9.5
relationship 9.4
star 9.3
elegance 9.2
20s 9.2
successful 9.2
businesswoman 9.1
sensuality 9.1
garment 9
one 9
boy 8.9
job 8.9
adolescent 8.6
cute 8.6
stand 8.5
passion 8.5
friendly 8.2
lady 8.1
beard 8.1
child 7.7
mother 7.7
confidence 7.7
jeans 7.6
fashionable 7.6
togetherness 7.6
clothes 7.5
glasses 7.4
juvenile 7.3
sensual 7.3
romantic 7.1
modern 7
look 7

Google
created on 2019-05-28

Microsoft
created on 2019-05-28

person 99
clothing 97.1
posing 92.2
outdoor 90.9
human face 90.2
standing 85.1
white 67.7
smile 67
people 61.9
black and white 56.5
man 54.5
old 48.4
clothes 19.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.8%
Angry 1.1%
Sad 2.2%
Surprised 0.7%
Confused 0.6%
Happy 1.1%
Calm 93.7%
Disgusted 0.5%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Happy 0.2%
Disgusted 0.2%
Surprised 0.2%
Calm 5.3%
Angry 1.2%
Confused 0.7%
Sad 92.3%

AWS Rekognition

Age 26-43
Gender Female, 89.7%
Sad 3.4%
Calm 81.5%
Happy 1%
Disgusted 5.4%
Surprised 0.8%
Angry 7.5%
Confused 0.5%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 98.1%
Suit 88.1%
Hat 81.8%
Painting 64.4%

Captions

Microsoft

a group of people posing for a photo 98.4%
a group of people posing for the camera 98.3%
a group of people posing for a picture 98.2%