Human Generated Data

Title

Untitled (Levesque family portrait, 50th wedding anniversary)
Date

September 19, 1954
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18113

Human Generated Data

Title

Untitled (Levesque family portrait, 50th wedding anniversary)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

September 19, 1954

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18113

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.4
Person 99.4
Person 99.2
Person 99
Person 96.2
Person 96.1
Person 96.1
Person 95.3
People 94
Person 92.3
Person 89.5
Flooring 85.5
Clothing 81
Apparel 81
Accessories 80.6
Tie 80.6
Accessory 80.6
Person 77.1
Family 76.2
Tie 74.8
Footwear 72.8
Shoe 72.8
Coat 66.7
Overcoat 66.7
Suit 66.7
Tie 65.3
Shoe 60.3
Sitting 59.6
Furniture 59.3
Couch 59.3
Indoors 56.3
Room 56.3
Shoe 55.6
Suit 51.5

Clarifai
created on 2019-11-16

people 99.8
group 99.6
group together 98.7
woman 98.2
adult 96.8
man 94.7
many 94
child 93.7
wear 92.6
outfit 89.1
music 88.7
family 86
several 85.9
dinner jacket 85.9
boy 84.9
offspring 83.5
wedding 83.1
dress 82.9
singer 82.7
five 81.9

Imagga
created on 2019-11-16

people 35.7
man 31.6
person 31.4
classroom 28.3
room 26.1
businessman 23.8
business 23.1
male 22.8
group 22.6
men 22.3
team 18.8
happy 18.8
adult 18.6
professional 18.3
together 17.5
couple 17.4
kin 16.1
office 16.1
teacher 15.8
women 15.8
corporate 15.5
attractive 14.7
wind instrument 14.3
meeting 14.1
success 13.7
portrait 13.6
school 13.5
work 13.3
teamwork 13
executive 12.9
family 12.4
smiling 12.3
friends 12.2
singer 12.1
smile 12.1
musical instrument 12
musician 12
happiness 11.7
handsome 11.6
silhouette 11.6
lifestyle 11.6
holding 11.5
education 11.3
brass 11.2
pretty 11.2
youth 11.1
two 11
businesswoman 10.9
building 10.8
suit 10.8
job 10.6
child 10.6
student 10.6
modern 10.5
standing 10.4
black 10.4
girls 10
fashion 9.8
working 9.7
relationship 9.4
teen 9.2
love 8.7
diversity 8.6
boss 8.6
businesspeople 8.5
walking 8.5
educator 8.4
friendship 8.4
worker 8.3
performer 8.2
dress 8.1
to 8
interior 8
indoors 7.9
cute 7.9
holiday 7.9
diverse 7.8
boy 7.8
elegant 7.7
reading 7.6
communication 7.6
dark 7.5
manager 7.4
lady 7.3
new 7.3
mother 7.2
posing 7.1
kid 7.1
life 7

Google
created on 2019-11-16

Photograph 96.4
People 94.8
Social group 90
Snapshot 87.5
Black-and-white 87.2
Monochrome 84.9
Photography 79.9
Fun 76.8
Room 71.4
Family 65.2
Picture frame 63.5
Monochrome photography 57.8
Child 57.3
Style 51
Art 50.2

Microsoft
created on 2019-11-16

person 98.8
clothing 98.7
smile 94.2
text 93.3
posing 93.2
human face 87.6
group 82.8
boy 82
footwear 77.5
child 76.2
man 64
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Female, 54.8%
Angry 45.8%
Surprised 49.3%
Sad 45.1%
Fear 45.6%
Calm 46.4%
Happy 46.9%
Confused 45.4%
Disgusted 45.5%

AWS Rekognition

Age 32-48
Gender Male, 54.6%
Fear 45.2%
Angry 48.2%
Calm 46.8%
Happy 46.4%
Sad 45.8%
Disgusted 47.2%
Confused 45.3%
Surprised 45.2%

AWS Rekognition

Age 3-11
Gender Male, 54.9%
Angry 45.2%
Fear 45%
Disgusted 45%
Sad 48.7%
Confused 45.1%
Calm 50.8%
Happy 45.1%
Surprised 45%

AWS Rekognition

Age 21-33
Gender Female, 54.5%
Calm 46.8%
Sad 45.2%
Fear 45.3%
Disgusted 45.2%
Confused 46%
Surprised 51%
Happy 45.2%
Angry 45.4%

AWS Rekognition

Age 51-69
Gender Male, 55%
Happy 45%
Sad 45.1%
Confused 45.1%
Disgusted 45.1%
Angry 45.3%
Surprised 45.1%
Calm 54.4%
Fear 45%

AWS Rekognition

Age 4-12
Gender Male, 53.7%
Surprised 45.1%
Confused 45.2%
Sad 45.1%
Disgusted 45.1%
Angry 45.1%
Calm 48.6%
Fear 45.1%
Happy 50.7%

AWS Rekognition

Age 51-69
Gender Female, 51.2%
Calm 52.1%
Sad 47.2%
Angry 45.3%
Disgusted 45%
Happy 45%
Surprised 45.1%
Fear 45.2%
Confused 45.1%

AWS Rekognition

Age 1-7
Gender Male, 54.6%
Disgusted 45%
Happy 45%
Confused 45%
Angry 45%
Fear 45%
Sad 54.9%
Calm 45.1%
Surprised 45%

AWS Rekognition

Age 5-15
Gender Female, 52.2%
Surprised 47.4%
Fear 45.9%
Angry 47%
Disgusted 45.3%
Sad 45.3%
Calm 46.2%
Happy 47.7%
Confused 45.2%

AWS Rekognition

Age 54-72
Gender Male, 54.6%
Calm 48.9%
Confused 46.1%
Fear 45.5%
Sad 45.8%
Angry 45.8%
Surprised 45.6%
Disgusted 47.2%
Happy 45.2%

AWS Rekognition

Age 6-16
Gender Female, 53.7%
Surprised 45.1%
Happy 45.1%
Sad 45.4%
Fear 45.1%
Calm 53.9%
Confused 45.2%
Disgusted 45%
Angry 45.3%

AWS Rekognition

Age 17-29
Gender Male, 50.4%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.4%
Fear 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 80.6%
Shoe 72.8%
Suit 66.7%

Categories

Imagga

people portraits 56.9%
paintings art 27.5%
streetview architecture 10.1%
events parties 4.2%

Text analysis

Amazon

T3342
-XAOX

Google

YT3RA --AGON
YT3RA
--AGON