Human Generated Data

Title

Rocio, Spain

Date

1963

People

Artist: George Krause, American born 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.297

Human Generated Data

Title

Rocio, Spain

People

Artist: George Krause, American born 1937

Date

1963

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Face 99.9
Human 99.9
Person 99.7
Person 98.3
Smile 95.7
Female 93.8
Clothing 90
Apparel 90
Head 85.7
Portrait 79.1
Photo 79.1
Photography 79.1
People 77.1
Girl 76.9
Woman 71.8
Kid 67
Child 67
Teen 60.7
Blonde 58.6
Selfie 58.3

Imagga
created on 2022-05-28

man 46.4
portrait 40.8
male 38
attractive 32.9
people 32.4
double 32
person 31.1
face 29.1
adult 27.3
smile 27.1
happy 27
handsome 26.8
sibling 26.3
casual 24.6
couple 23.5
world 20.3
black 20
youth 19.6
smiling 19.5
hair 19
love 18.9
looking 16.8
happiness 16.5
model 16.3
men 16.3
lifestyle 15.9
expression 15.4
together 14.9
boy 14.8
pretty 14.7
fashion 14.3
guy 14.3
romance 14.3
cheerful 13.8
sexy 13.7
cute 13.6
serious 13.4
look 13.1
brunette 13.1
one 12.7
marriage 12.4
mature 12.1
dark 11.7
married 11.5
close 11.4
studio 11.4
relationship 11.2
teenager 10.9
head 10.9
closeup 10.8
romantic 10.7
outdoors 10.5
eyes 10.3
professional 10.3
cool 9.8
human 9.8
ethnic 9.5
senior 9.4
beard 9.1
standing 8.7
shirt 8.7
boyfriend 8.7
girlfriend 8.7
clothing 8.6
two 8.5
teen 8.3
friendly 8.2
fun 8.2
confident 8.2
style 8.2
family 8
student 8
husband 7.9
dating 7.8
modern 7.7
joy 7.5
emotion 7.4
brown 7.4
lady 7.3
business 7.3
pose 7.3
women 7.1
work 7.1

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

person 99.5
human face 99.3
wall 98.9
woman 97.4
portrait 92.5
black and white 90.6
clothing 89.9
posing 88
black 78.6
smile 78.2
fashion accessory 70.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 94.6%
Sad 99.5%
Calm 35%
Surprised 6.4%
Fear 6.1%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 48-54
Gender Male, 92.4%
Happy 93.3%
Surprised 6.8%
Fear 6.7%
Sad 2.5%
Calm 1%
Confused 0.9%
Disgusted 0.4%
Angry 0.3%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man and woman posing for a photo 94.6%
a man and a woman posing for a photo 94.5%
a couple of people posing for the camera 94.4%