Human Generated Data

Title

Untitled (slow ghost exposure of elderly couple with woman standing on the left and man seated on the right)
Date

c. 1905-1915, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6025

Human Generated Data

Title

Untitled (slow ghost exposure of elderly couple with woman standing on the left and man seated on the right)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6025

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.5
Person 99.5
Clothing 99.2
Apparel 99.2
Person 98.8
Person 97.7
Person 97.5
Person 97.5
Person 97.2
Overcoat 82.9
Sleeve 78.3
People 71.5
Suit 70.5
Jacket 67.5
Text 66.6
Pants 64.1
Screen 63.9
Electronics 63.9
Shorts 60.1
Advertisement 59.2
Monitor 56.2
Display 56.2
Coat 53

Clarifai
created on 2019-11-16

people 99.8
group 99
man 97.3
wear 96.7
woman 96.4
adult 96.3
group together 95.3
child 94.8
administration 89.8
music 89.6
movie 88.9
many 88.9
monochrome 88.3
portrait 88.2
musician 83.9
several 82.9
retro 82.9
four 82.7
uniform 82.4
outfit 81.3

Imagga
created on 2019-11-16

man 26.2
person 24.2
people 22.3
male 21.3
black 20.8
silhouette 19.9
world 18.1
adult 16.3
water 15.3
sexy 15.3
portrait 14.2
happy 13.8
one 13.4
body 12.8
human 12.7
hair 11.9
television 11.7
dark 11.7
model 11.7
groom 11.6
attractive 11.2
love 11
light 10.7
fashion 10.5
happiness 10.2
sensuality 10
sunset 9.9
business 9.7
businessman 9.7
dance 9.7
wet 8.9
posing 8.9
night 8.9
life 8.8
couple 8.7
smile 8.5
expression 8.5
clothing 8.5
skin 8.5
kin 8.4
leisure 8.3
landscape 8.2
sensual 8.2
style 8.2
symbol 8.1
women 7.9
men 7.7
summer 7.7
pretty 7.7
old 7.7
sport 7.5
fun 7.5
vintage 7.4
action 7.4
alone 7.3
lady 7.3
sky 7

Google
created on 2019-11-16

Photograph 96.3
Snapshot 85.9
Black-and-white 85.4
Picture frame 82.1
Art 80
Visual arts 75.9
Photography 75.7
Photographic paper 69.7
Room 65.7
Stock photography 64
Monochrome 54.4
Family 51

Microsoft
created on 2019-11-16

posing 99.6
text 99
clothing 99
wall 97.3
man 96.6
person 95.3
standing 94.4
smile 89.2
group 87.2
old 86.8
suit 86.7
window 80.8
human face 73.5
people 56.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 52.6%
Angry 50.8%
Happy 45%
Disgusted 45.1%
Sad 46.2%
Calm 46.6%
Surprised 45.2%
Confused 45.4%
Fear 45.7%

AWS Rekognition

Age 7-17
Gender Male, 54.9%
Disgusted 45.1%
Angry 52.5%
Calm 47.2%
Surprised 45%
Sad 45.1%
Confused 45.1%
Fear 45%
Happy 45%

AWS Rekognition

Age 6-16
Gender Female, 50%
Happy 54.7%
Fear 45%
Angry 45%
Confused 45%
Calm 45.2%
Disgusted 45%
Surprised 45%
Sad 45%

AWS Rekognition

Age 5-15
Gender Male, 54.5%
Angry 47%
Calm 49.4%
Happy 45%
Sad 48.3%
Fear 45%
Surprised 45%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 39-57
Gender Male, 54.4%
Surprised 46.1%
Calm 51.3%
Happy 46.4%
Angry 45.7%
Fear 45.1%
Sad 45.1%
Confused 45.2%
Disgusted 45%

AWS Rekognition

Age 55-73
Gender Female, 52.9%
Sad 45.1%
Disgusted 45%
Happy 50.4%
Confused 45%
Fear 45%
Angry 45%
Calm 49.3%
Surprised 45.1%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Suit 70.5%
Coat 53%

Categories

Imagga

paintings art 94.8%
people portraits 4.1%