Human Generated Data

Title

Untitled (older woman standing with four children in front of fireplace and painting of man, girls hold flowers)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12947

Human Generated Data

Title

Untitled (older woman standing with four children in front of fireplace and painting of man, girls hold flowers)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12947

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.6
Person 99.6
Person 99.3
Person 99
Person 97.8
Person 97.1
Apparel 97
Clothing 97
Shoe 95.9
Footwear 95.9
Shoe 94.5
Couch 89.2
Furniture 89.2
Person 86.3
Indoors 84.6
Shoe 81.7
People 81.3
Living Room 80
Room 80
Sleeve 78.2
Plant 72.2
Shoe 70.8
Fireplace 70
Flooring 61.7
Shoe 61.2
Long Sleeve 59.1
Shorts 58.8
Door 56.8
Female 56.2
Family 56
Pants 55.5
Girl 55.4
Tree 55.3
Person 43.9

Clarifai
created on 2019-11-16

people 100
child 99.5
group 99.1
family 97.4
offspring 96.6
actress 96
wear 95.5
portrait 94.8
adult 94.7
group together 94.7
sibling 94
woman 92.6
princess 92.4
two 92
many 90.9
administration 89.3
three 88.2
several 86.9
leader 86.8
four 86.6

Imagga
created on 2019-11-16

people 20.1
fashion 18.8
person 18.6
man 18.3
adult 16.8
black 16.6
dress 16.2
holiday 15
portrait 14.2
style 14.1
shop 14
world 12.8
nurse 12.8
women 12.6
happy 12.5
family 12.4
interior 12.4
attractive 11.9
happiness 11.7
male 11.5
clothing 11.4
lady 11.4
urban 11.3
couple 11.3
sexy 11.2
looking 11.2
home 11.2
blackboard 10.6
pretty 10.5
group 10.5
gift 10.3
men 10.3
room 10
elegance 9.2
traditional 9.1
indoor 9.1
toyshop 9.1
window 9.1
childhood 8.9
decoration 8.8
indoors 8.8
hair 8.7
cute 8.6
elegant 8.6
domestic 8.4
city 8.3
vintage 8.3
child 8.2
children 8.2
mother 8.1
performer 8.1
symbol 8.1
kin 7.8
smile 7.8
model 7.8
musician 7.8
play 7.7
youth 7.7
two 7.6
human 7.5
tradition 7.4
daughter 7.3
light 7.3
girls 7.3
business 7.3
blond 7.2
posing 7.1

Google
created on 2019-11-16

Photograph 96.9
Black 95.4
Snapshot 87.3
Room 85.4
Black-and-white 85.4
Standing 84.2
Picture frame 84.2
Photography 80.4
Child 76.5
Stock photography 68.5
Monochrome 67.6
Family 59.5
Monochrome photography 57.8
Photographic paper 55.7
Style 52.5
Vintage clothing 50.7

Microsoft
created on 2019-11-16

wall 97.3
clothing 95.4
toddler 90.6
person 88.6
baby 83.5
girl 79.2
text 78.3
human face 77.7
smile 76.2
dress 74.9
posing 68.1
old 49.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 52.3%
Angry 45.8%
Sad 46.3%
Confused 45%
Calm 52.7%
Surprised 45%
Happy 45%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 2-8
Gender Female, 54.7%
Calm 45.4%
Surprised 45%
Happy 45%
Sad 46.1%
Confused 45%
Angry 46.3%
Fear 52.1%
Disgusted 45%

AWS Rekognition

Age 2-8
Gender Male, 53.9%
Fear 45.8%
Surprised 45%
Confused 45%
Sad 50.5%
Disgusted 45%
Happy 45%
Calm 48.3%
Angry 45.3%

AWS Rekognition

Age 4-14
Gender Female, 54.7%
Disgusted 45%
Confused 45%
Fear 45%
Calm 45.7%
Happy 45%
Surprised 45%
Angry 45.1%
Sad 54.2%

AWS Rekognition

Age 50-68
Gender Female, 54.9%
Happy 45%
Confused 45%
Calm 45%
Fear 45.2%
Angry 45%
Surprised 45%
Disgusted 45%
Sad 54.8%

AWS Rekognition

Age 39-57
Gender Female, 50.5%
Fear 45.3%
Angry 45.1%
Sad 53.9%
Happy 45.1%
Calm 45.6%
Confused 45.1%
Surprised 45%
Disgusted 45%

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 95.9%