Human Generated Data

Title

Group of Mambo Musicians

Date

c. 1924-76, printed 2005

People

Artist: Baldomero Alejos, Peruvian 1902-1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the David Rockefeller Center for Latin American Studies, Harvard University, Estrellita Bograd Brodsky Fund for Latin American Art and Culture and Gustavo E. Brillembourg Memorial Fund, 2012.123

Human Generated Data

Title

Group of Mambo Musicians

People

Artist: Baldomero Alejos, Peruvian 1902-1976

Date

c. 1924-76, printed 2005

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-28

Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.5
Musician 98.9
Musical Instrument 98.9
Person 98.6
Shoe 97.1
Footwear 97.1
Clothing 97.1
Apparel 97.1
Leisure Activities 94.6
Guitar 94.6
Music Band 93.3
Person 92.1
Person 86.7
Performer 85.9
Percussion 79
Drum 79
People 78.9
Shoe 77.5
Guitarist 76.2
Shoe 66.8
Guitar 60.7

Clarifai
created on 2019-05-28

people 99.9
group 99.8
group together 99
adult 97.2
child 97
music 97
musician 96.9
wear 96.6
woman 95.5
five 94.8
man 94.5
many 94.4
several 94
sibling 92.5
singer 91.9
four 91.1
administration 90.9
recreation 90.9
outfit 89.8
portrait 89

Imagga
created on 2019-05-28

kin 100
people 33.4
couple 27.8
man 24.2
male 22.7
person 22.6
happy 22.5
adult 20.6
portrait 20
together 18.4
happiness 18
attractive 17.5
smiling 17.3
dress 17.1
family 16.9
pretty 16.8
group 16.1
fashion 15.8
love 15.8
two 15.2
women 15
fun 15
style 14.8
cheerful 14.6
lifestyle 14.4
child 14.2
mother 14.1
musical instrument 13.7
youth 13.6
wind instrument 13.4
brass 13.4
friends 13.1
sexy 12.8
smile 12.1
musician 11.8
romance 11.6
bride 11.5
cute 11.5
boy 11.3
standing 11.3
men 11.2
teen 11
holding 10.7
lady 10.5
performer 10.5
culture 10.2
expression 10.2
black 10.2
singer 10
hand 9.9
romantic 9.8
outdoors 9.7
clothing 9.6
teenage 9.6
married 9.6
brunette 9.6
relationship 9.4
friendship 9.4
parent 9.3
holiday 9.3
face 9.2
leisure 9.1
handsome 8.9
kid 8.9
summer 8.3
studio 8.3
joy 8.3
color 8.3
traditional 8.3
human 8.2
teenager 8.2
blond 8.1
hair 7.9
daughter 7.9
husband 7.8
room 7.8
model 7.8
play 7.7
party 7.7
casual 7.6
elegance 7.5
togetherness 7.5
bouquet 7.5
clothes 7.5
park 7.4
groom 7.4
wedding 7.3
20s 7.3
playing 7.3
gorgeous 7.2
success 7.2
looking 7.2
to 7.1
modern 7

Google
created on 2019-05-28

Photograph 95.3
People 94.8
Team 70.5
Family 61.1
Crew 55.9

Microsoft
created on 2019-05-28

person 99.9
musical instrument 99.8
drum 99.6
posing 95.8
standing 87.1
group 81.9
membranophone 78.6
clothing 73.5
guitar 73.3
accordion 63.8
drumhead 59.1
black and white 56.9
musician 55.5
man 53.8
banjo 52.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Male, 54.9%
Angry 45.3%
Disgusted 45.1%
Happy 45.1%
Sad 45.8%
Calm 52.8%
Surprised 45.2%
Confused 45.7%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Happy 45.7%
Angry 45.6%
Confused 45.7%
Calm 50.8%
Sad 46.3%
Surprised 45.8%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Surprised 45.1%
Happy 45.2%
Sad 46%
Angry 45.2%
Confused 45.2%
Disgusted 45%
Calm 53.2%

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Calm 51.9%
Disgusted 45.6%
Surprised 45.2%
Confused 45.5%
Happy 45.5%
Sad 45.9%
Angry 45.4%

AWS Rekognition

Age 17-27
Gender Male, 54.9%
Angry 45%
Disgusted 45%
Happy 45%
Sad 45.3%
Calm 54.5%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 14-25
Gender Male, 54.7%
Angry 45.2%
Sad 46%
Surprised 45.2%
Confused 45.2%
Happy 45%
Calm 53.2%
Disgusted 45%

AWS Rekognition

Age 20-38
Gender Male, 55%
Surprised 45.1%
Sad 45.4%
Happy 45%
Confused 45.4%
Angry 45.1%
Disgusted 45%
Calm 54%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 97.1%
Guitar 94.6%

Captions

Microsoft

a group of people posing for a photo 98.8%
a group of people posing for a picture 98.7%
a group of people posing for the camera 98.6%