Human Generated Data

Title

Untitled (neighborhood scene)

Date

1980s

People

Artist: Dick Rodgers and Janet Mendelsohn, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1938

Human Generated Data

Title

Untitled (neighborhood scene)

People

Artist: Dick Rodgers and Janet Mendelsohn, American

Date

1980s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1938

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.5
Clothing 98.6
Apparel 98.6
Person 94.1
Face 80.8
Person 79.4
Pants 75.7
Sleeve 71.7
Coat 66.9
Overcoat 65
Person 63.2
Shorts 61.5
Portrait 61
Photography 61
Photo 61
Slate 55
Wood 55
Person 51.4

Clarifai
created on 2023-10-26

people 99.8
monochrome 99.7
street 99.5
black and white 98.7
child 98.2
portrait 97.7
woman 97.6
adult 96.5
mono 95.2
two 94.5
bench 94.4
boy 93.6
girl 93.6
man 93.2
group 92.1
art 91.5
son 90.5
analogue 85.1
baby 84.5
photojournalism 83.4

Imagga
created on 2022-01-23

kin 42.4
people 30.1
adult 25.9
man 24.9
portrait 24.6
love 22.1
person 20.8
outdoors 20.2
sitting 19.8
male 18.6
couple 18.3
child 17.5
attractive 17.5
outdoor 16.8
hair 16.6
world 16.6
park 16.5
happiness 16.4
happy 16.3
lifestyle 15.9
model 15.5
mother 15.3
fashion 14.3
bench 14.3
smile 14.2
family 14.2
blond 13.4
face 12.8
old 12.5
cute 12.2
outside 12
casual 11.9
black 11.8
park bench 11.6
smiling 11.6
human 11.2
looking 11.2
pretty 11.2
grass 11.1
street 11
city 10.8
leisure 10.8
seat 10.7
lady 10.5
together 10.5
jeans 10.5
one 10.4
sexy 10.4
men 10.3
summer 10.3
youth 10.2
sibling 9.8
fun 9.7
urban 9.6
boy 9.6
women 9.5
day 9.4
relationship 9.4
posing 8.9
father 8.8
sadness 8.8
wife 8.5
togetherness 8.5
two 8.5
joy 8.4
life 8.4
romance 8
scene 7.8
eyes 7.7
parent 7.7
sad 7.7
lonely 7.7
married 7.7
relaxation 7.5
senior 7.5
vintage 7.4
teenager 7.3
girls 7.3
clothing 7.2
home 7.2
childhood 7.2
interior 7.1
autumn 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

outdoor 99.5
person 98.9
ground 97.2
black and white 95.5
clothing 94.6
footwear 86.9
monochrome 79.2
woman 77.3
text 75.8
street 70.6
human face 60
statue 59.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Male, 99.9%
Calm 81.5%
Sad 17.5%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%
Happy 0.1%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Male, 68.8%
Sad 94.5%
Calm 5.4%
Confused 0%
Angry 0%
Fear 0%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 36-44
Gender Female, 100%
Sad 59.2%
Calm 34.1%
Angry 1.3%
Surprised 1.2%
Confused 1.2%
Happy 1.1%
Fear 1.1%
Disgusted 0.8%

AWS Rekognition

Age 0-3
Gender Male, 99.8%
Calm 69.1%
Sad 19.6%
Fear 5%
Disgusted 1.8%
Confused 1.7%
Angry 1.5%
Surprised 0.9%
Happy 0.3%

AWS Rekognition

Age 7-17
Gender Female, 92.4%
Calm 73.1%
Sad 22.1%
Fear 1.6%
Confused 1.5%
Angry 0.6%
Surprised 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 52%
Sad 33.8%
Confused 6%
Fear 3.6%
Disgusted 1.6%
Angry 1.5%
Surprised 1.1%
Happy 0.5%

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories