Human Generated Data

Title

Untitled (portrait of Garner family in living room)
Date

1954
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2849

Human Generated Data

Title

Untitled (portrait of Garner family in living room)

People

Artist: Harry Annas, American 1897 - 1980

Date

1954

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2849

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Person 99.3
Human 99.3
Person 98.5
Person 98.3
Person 98.3
Person 98.2
Person 98.1
Person 97
Person 95.7
Person 95.6
Clothing 95.3
Apparel 95.3
Person 94.2
Person 93.6
Person 93.5
People 91.8
Person 91.8
Face 90.7
Person 90.3
Tie 87.2
Accessories 87.2
Accessory 87.2
Dress 82.2
Furniture 80.9
Tie 79.8
Indoors 73.2
Kid 72.8
Child 72.8
Chair 70.5
Room 68
Female 67.8
Suit 67.7
Coat 67.7
Overcoat 67.7
Table 65.2
Baby 64
Living Room 62.7
Family 62.1
Portrait 61.6
Photography 61.6
Photo 61.6
Couch 60
Tie 59.4
Shorts 57.8
Girl 57.7
Door 57.1

Clarifai
created on 2023-10-26

people 100
group 99.9
child 99.6
many 98.6
group together 98.5
family 96.9
son 95
woman 94.9
man 94.9
education 94.1
administration 93.9
adult 92.7
boy 92.5
leader 92.4
sibling 92.2
several 90.1
school 88.1
actor 87.7
nostalgia 87.3
outfit 86.8

Imagga
created on 2022-01-16

kin 51.7
brass 36.2
wind instrument 28.7
people 27.9
man 22.9
musical instrument 20.1
person 19.4
cornet 19.4
blackboard 18.5
male 18.5
couple 18.3
love 15
happiness 14.1
men 13.7
two 13.5
women 13.4
happy 13.1
portrait 12.9
dress 12.6
bride 12.5
businessman 12.3
adult 11.9
silhouette 11.6
family 11.6
celebration 11.2
wedding 11
child 10.7
art 10.5
boy 10.4
nurse 10.4
smiling 10.1
girls 10
old 9.7
business 9.7
outdoors 9.7
wife 9.5
sport 9.4
symbol 9.4
outdoor 9.2
vintage 9.1
fashion 9
black 9
fun 9
cheerful 8.9
together 8.7
party 8.6
mother 8.6
friendship 8.4
summer 8.3
human 8.2
park 8.2
retro 8.2
active 8.1
group 8.1
life 8
drawing 7.8
standing 7.8
face 7.8
ceremony 7.8
married 7.7
statue 7.6
walking 7.6
sign 7.5
leisure 7.5
holding 7.4
groom 7.4
water 7.3
decoration 7.2
history 7.1
romance 7.1
grass 7.1
to 7.1
interior 7.1
day 7.1

Google
created on 2022-01-16

Black 89.6
Style 83.8
Dress 83.6
Adaptation 79.2
People 78
Picture frame 76.8
Monochrome 76.7
Vintage clothing 76
Monochrome photography 75.2
Event 71
Chair 68.6
Room 68.3
Classic 67.8
Suit 67.1
History 64.6
Stock photography 64
Photo caption 60.1
Art 59.5
Family reunion 58.7
Photographic paper 57.9

Microsoft
created on 2022-01-16

person 98.7
clothing 97.9
outdoor 91.3
black 79.7
man 77.9
old 77.9
player 75.1
boy 71.5
text 68.3
group 63.3
footwear 63
white 62.6
posing 61.1
crowd 0.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 98.2%
Happy 61%
Sad 13.7%
Calm 13.2%
Confused 4.7%
Surprised 3.2%
Disgusted 2%
Angry 1.4%
Fear 0.8%

AWS Rekognition

Age 27-37
Gender Male, 92.5%
Calm 34.9%
Sad 33.1%
Happy 28.1%
Confused 1.5%
Surprised 0.8%
Disgusted 0.7%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 70.5%
Sad 25%
Happy 1.3%
Confused 1%
Angry 0.8%
Disgusted 0.7%
Surprised 0.5%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 53.5%
Happy 74.2%
Sad 12.6%
Calm 7.4%
Confused 2%
Surprised 1.5%
Disgusted 0.9%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 38-46
Gender Male, 98.5%
Sad 55.3%
Happy 30.8%
Calm 9.7%
Fear 1.1%
Confused 0.9%
Disgusted 0.7%
Surprised 0.7%
Angry 0.7%

AWS Rekognition

Age 30-40
Gender Female, 83.5%
Calm 66.6%
Sad 16.5%
Happy 9.4%
Surprised 2.8%
Confused 2.3%
Disgusted 1.4%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 98.2%
Calm 81.9%
Sad 17%
Surprised 0.3%
Angry 0.2%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 40-48
Gender Male, 96.4%
Happy 98.4%
Surprised 0.5%
Calm 0.4%
Sad 0.3%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Sad 80.2%
Happy 10.4%
Calm 3%
Angry 2.3%
Confused 1.4%
Fear 1%
Disgusted 0.8%
Surprised 0.8%

AWS Rekognition

Age 40-48
Gender Male, 71.1%
Surprised 98.9%
Happy 0.8%
Angry 0.1%
Fear 0.1%
Calm 0.1%
Disgusted 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Happy 99.6%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%
Calm 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Sad 50.5%
Calm 14.6%
Happy 11%
Confused 7.6%
Surprised 6.7%
Angry 5.8%
Disgusted 2.2%
Fear 1.5%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 95.8%
Sad 1.9%
Angry 0.7%
Happy 0.5%
Surprised 0.4%
Disgusted 0.3%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 70.9%
Calm 71.9%
Happy 26%
Angry 0.6%
Sad 0.6%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 71.3%
Calm 19.7%
Disgusted 2.5%
Angry 2.1%
Surprised 1.7%
Confused 1.1%
Sad 1%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 87.2%

Categories

Imagga

people portraits 85.8%
streetview architecture 6.3%
paintings art 4.7%
events parties 1.4%

Text analysis

Amazon

BID