Human Generated Data

Title

Untitled (family Christmas card: family portrait with puppies)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16886

Human Generated Data

Title

Untitled (family Christmas card: family portrait with puppies)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16886

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.8
Human 99.8
Person 99.2
Person 97.5
Person 96.3
Person 95.2
People 88.2
Dog 86.1
Mammal 86.1
Canine 86.1
Pet 86.1
Animal 86.1
Guitar 69.6
Musical Instrument 69.6
Leisure Activities 69.6
Doctor 59.9
Living Room 59.6
Indoors 59.6
Room 59.6
Clinic 55.6
Icing 55.4
Food 55.4
Dessert 55.4
Cake 55.4
Cream 55.4
Creme 55.4

Clarifai
created on 2023-10-29

people 99.9
monochrome 99.3
adult 98.8
group 98
man 98
woman 97.4
child 95.7
administration 90.6
sit 90.4
many 90
group together 89.9
leader 88.9
sitting 87.8
adolescent 87.1
indoors 85.6
education 83.3
facial expression 81.4
teacher 78.6
medical practitioner 76
music 75.7

Imagga
created on 2022-02-26

man 26.2
newspaper 19.1
people 18.9
person 17.7
male 17
product 15.9
couple 14.8
business 12.7
adult 12.4
creation 12.1
money 11.9
love 11.8
finance 11.8
dress 11.7
wealth 11.7
financial 11.6
daily 11.5
home 11.2
men 11.2
old 11.1
room 10.8
happy 10.6
fun 10.5
kin 10.3
lifestyle 10.1
currency 9.9
portrait 9.7
one 9.7
bride 9.6
player 9.5
happiness 9.4
smile 9.3
banking 9.2
vintage 9.1
outdoors 8.9
new 8.9
family 8.9
to 8.8
smiling 8.7
dollar 8.3
joy 8.3
wedding 8.3
cash 8.2
retro 8.2
cheerful 8.1
bank 8.1
activity 8.1
groom 8
celebration 8
businessman 7.9
color 7.8
decoration 7.7
dollars 7.7
us 7.7
married 7.7
two 7.6
bill 7.6
art 7.5
leisure 7.5
close 7.4
women 7.1
indoors 7
modern 7

Google
created on 2022-02-26

Table 84.7
Art 82.1
Adaptation 79.2
Snapshot 74.3
Font 73.8
Vintage clothing 73.3
Room 70.3
Event 69.9
Photo caption 69.8
Suit 66.7
History 66
Classic 65.5
Illustration 65
Painting 64.8
Stock photography 64.2
Curtain 63.4
Chair 62.9
Monochrome 61.1
Hat 60.8
Monochrome photography 58.9

Microsoft
created on 2022-02-26

text 99.9
person 94.3
clothing 85.5
man 71.7
people 61.3
cartoon 56.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 93.3%
Happy 94.3%
Surprised 1.4%
Sad 1.1%
Calm 0.9%
Fear 0.8%
Disgusted 0.7%
Confused 0.6%
Angry 0.3%

AWS Rekognition

Age 33-41
Gender Male, 88.3%
Happy 55.2%
Calm 28%
Sad 7.1%
Confused 6.9%
Disgusted 1.2%
Surprised 0.8%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 42-50
Gender Male, 94.8%
Happy 48.1%
Calm 36.6%
Confused 8.6%
Surprised 2.6%
Sad 1.7%
Angry 1.4%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Female, 96.8%
Calm 72.1%
Happy 18.6%
Surprised 3.4%
Sad 3.2%
Confused 1.6%
Disgusted 0.6%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 42-50
Gender Male, 96.9%
Happy 99.2%
Calm 0.3%
Surprised 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 10-18
Gender Female, 79.5%
Surprised 47.2%
Fear 29.2%
Sad 9.1%
Calm 4.4%
Angry 3.9%
Happy 3%
Confused 1.8%
Disgusted 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog
Guitar
Person 99.8%
Person 99.2%
Person 97.5%
Person 96.3%
Person 95.2%
Dog 86.1%
Guitar 69.6%

Categories

Text analysis

Amazon

Christmas-The
4
Merry Christmas-The Glaefkes
Glaefkes
Merry

Google

E. Merry Christmas-The Glacfkes
E.
Merry
Christmas-The
Glacfkes