Human Generated Data

Title

Untitled (family portrait with many dogs and puppies)

Date

1962

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17872

Human Generated Data

Title

Untitled (family portrait with many dogs and puppies)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17872

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Interior Design 99.8
Indoors 99.8
Person 99.6
Human 99.6
Person 98.8
Person 97.8
Leisure Activities 97.4
Person 96.4
Guitar 94.6
Musical Instrument 94.6
Person 94.5
Room 93
Dog 91.4
Mammal 91.4
Animal 91.4
Canine 91.4
Pet 91.4
Musician 85.6
Music Band 79.3
Chair 78.4
Furniture 78.4
Crowd 62.5
Person 61.9
Guitarist 59.5
Performer 59.5
Banjo 57.8

Clarifai
created on 2023-10-29

people 99.9
man 98.8
group 98.5
woman 98.3
adult 97.9
group together 96.3
child 95.7
sit 95
indoors 94
monochrome 93.9
dining room 93.5
furniture 91.3
room 89.9
many 89.6
family 88.9
boy 87.5
administration 87.2
table 86.5
several 83.9
leader 82

Imagga
created on 2022-02-26

man 37.6
people 31.7
percussion instrument 28.9
male 28.3
musical instrument 27.3
person 24.9
home 23.9
senior 23.4
kin 22.3
happy 19.4
adult 19.3
mature 18.6
couple 17.4
room 17.1
nurse 16.8
men 16.3
elderly 16.3
family 16
uniform 14.2
steel drum 14.1
old 13.9
smiling 13.7
sitting 13.7
lifestyle 13.7
professional 13.3
medical 13.2
care 13.1
portrait 12.9
patient 12.4
together 12.2
hospital 12.2
smile 12.1
group 12.1
drum 12
women 11.8
worker 11.8
health 11.8
business 11.5
indoors 11.4
team 10.7
retired 10.6
cheerful 10.6
retirement 10.5
happiness 10.2
horizontal 10
interior 9.7
businessman 9.7
table 9.5
talking 9.5
meeting 9.4
work 9.4
day 9.4
casual 9.3
camera 9.2
holding 9.1
human 9
working 8.8
half length 8.8
kettle 8.7
love 8.7
clothing 8.6
two 8.5
indoor 8.2
outdoors 8.2
businesswoman 8.2
office 8.1
mother 8.1
looking 8
celebration 8
to 8
70s 7.9
casual clothing 7.8
color 7.8
discussion 7.8
two people 7.8
older 7.8
30s 7.7
married 7.7
husband 7.6
wife 7.6
laughing 7.6
help 7.4
teamwork 7.4
20s 7.3
aged 7.2
decoration 7.2
teacher 7.2
job 7.1
medicine 7

Google
created on 2022-02-26

Table 89.6
Black 89.5
Black-and-white 85.6
Style 84
Couch 77.7
Monochrome photography 76.2
Monochrome 75.2
Hat 74.7
Suit 74.1
Vintage clothing 74
Room 72.1
Chair 71.6
Window 71.2
Art 70.1
Event 68.9
Classic 68.4
Picture frame 68.2
Sitting 67.8
Coffee table 66.8
Motor vehicle 65.5

Microsoft
created on 2022-02-26

text 99.2
person 98.6
clothing 84.4
group 66.5
man 62.1
posing 50.1
shop 14.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 94.6%
Happy 98.4%
Surprised 0.5%
Disgusted 0.4%
Calm 0.4%
Sad 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.8%
Happy 89.6%
Calm 5.1%
Confused 2.3%
Sad 2.2%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 28-38
Gender Male, 70%
Happy 92.7%
Surprised 5.7%
Calm 0.5%
Angry 0.4%
Sad 0.2%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 85%
Surprised 51.9%
Calm 34.2%
Sad 7.5%
Fear 2%
Happy 1.6%
Confused 1.2%
Angry 1%
Disgusted 0.4%

AWS Rekognition

Age 43-51
Gender Male, 86.1%
Calm 69.9%
Happy 16.8%
Sad 6.4%
Confused 3.6%
Surprised 1.8%
Angry 0.8%
Disgusted 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog
Person 99.6%
Person 98.8%
Person 97.8%
Person 96.4%
Person 94.5%
Person 61.9%
Dog 91.4%

Categories

Text analysis

Amazon

14
MJ17--YT37A°--AX

Google

CU
CU