Human Generated Data

Title

George's Branch Porch

Date

1991

People

Artist: Shelby Lee Adams, American born 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.32

Copyright

© Shelby Lee Adams Archive

Human Generated Data

Title

George's Branch Porch

People

Artist: Shelby Lee Adams, American born 1950

Date

1991

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.8
Person 99.8
Person 99.7
Person 99.4
Person 99.4
Person 99.4
Person 99.3
Person 99.3
Person 99.2
Leisure Activities 99.1
Person 98.8
Person 98.2
Banjo 96
Musical Instrument 96
Guitar 94.2
Person 89.9
Clothing 87.4
Hat 87.4
Apparel 87.4
Musician 83.6
Shoe 59
Footwear 59
Music Band 57.6

Imagga
created on 2022-01-08

kin 75.7
man 25.5
people 24.5
couple 24.4
love 22.9
portrait 22.6
adult 22.1
male 22.1
happy 21.3
fashion 19.6
sexy 19.3
dress 19
person 18.9
two 18.6
attractive 18.2
women 18.2
smiling 18.1
happiness 15.7
child 15.4
black 15
smile 15
together 14.9
world 13.9
sitting 13.7
family 13.3
pretty 13.3
sensuality 12.7
bride 12.5
mother 12.1
fun 12
hair 11.9
model 11.7
romantic 11.6
posing 11.6
face 11.4
brunette 11.3
groom 11.3
human 11.2
room 11.2
one 11.2
youth 11.1
girls 10.9
elegance 10.9
sensual 10.9
dark 10.9
joy 10.9
holding 10.7
lifestyle 10.1
wedding 10.1
vintage 9.9
interior 9.7
style 9.6
looking 9.6
marriage 9.5
men 9.4
romance 8.9
sexual 8.7
passion 8.5
relationship 8.4
20s 8.2
children 8.2
cheerful 8.1
music 8.1
home 8
cute 7.9
holiday 7.9
look 7.9
hands 7.8
married 7.7
loving 7.6
sit 7.6
friends 7.5
outdoors 7.5
daughter 7.4
joyful 7.3
teen 7.3
makeup 7.3
group 7.3
gorgeous 7.2
handsome 7.1
day 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99.9
posing 94.7
musical instrument 94.4
clothing 94.2
text 92.8
smile 89.9
human face 88.4
music 76.3
woman 74.3
group 74
people 74
guitar 57.3
black and white 51.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 96.2%
Angry 1.9%
Confused 0.8%
Sad 0.4%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.7%
Angry 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%
Confused 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 61-71
Gender Male, 99.7%
Happy 70.1%
Calm 14.6%
Angry 5.1%
Sad 3%
Fear 2.8%
Surprised 2.6%
Disgusted 1.2%
Confused 0.6%

AWS Rekognition

Age 52-60
Gender Male, 88.3%
Angry 98.3%
Confused 0.7%
Calm 0.3%
Disgusted 0.3%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Happy 98.7%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%
Fear 0.2%
Sad 0.1%
Surprised 0.1%
Calm 0.1%

AWS Rekognition

Age 36-44
Gender Female, 93.5%
Calm 99.2%
Confused 0.2%
Surprised 0.2%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 98.6%
Sad 0.5%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 100%
Happy 74.6%
Calm 10.5%
Surprised 6%
Confused 5.5%
Fear 1.4%
Sad 0.9%
Disgusted 0.7%
Angry 0.4%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 82.8%
Fear 8.3%
Surprised 3.7%
Angry 1.3%
Calm 1.2%
Confused 1.1%
Sad 0.8%
Disgusted 0.8%

AWS Rekognition

Age 54-62
Gender Female, 100%
Calm 95.7%
Angry 1.2%
Surprised 1%
Confused 0.9%
Sad 0.6%
Disgusted 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Happy 43.4%
Calm 30.2%
Confused 22.8%
Surprised 1.4%
Disgusted 1%
Angry 0.5%
Fear 0.3%
Sad 0.3%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Guitar 94.2%
Hat 87.4%
Shoe 59%

Captions

Microsoft

Amy Sakasitz et al. posing for a photo 98.6%
Amy Sakasitz et al. posing for the camera 98.5%
Amy Sakasitz et al. posing for a picture 98.4%

Text analysis

Amazon

1991
Gold
Mack
JOINT
1991 to
to
WORLDWIDE Mack
Porch"
WORLDWIDE
Gold Bo
Branch
Apps Branch Porch"
Bo
EQUIPMENT
ts
O
Apps

Google

Mack Gold Bo
Gold
Mack
Bo