Human Generated Data

Title

Untitled (family portrait with many dogs and puppies)
Date

1962
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17872

Human Generated Data

Title

Untitled (family portrait with many dogs and puppies)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Indoors 99.8
Interior Design 99.8
Person 99.6
Human 99.6
Person 98.8
Person 97.8
Leisure Activities 97.4
Person 96.4
Musical Instrument 94.6
Guitar 94.6
Person 94.5
Room 93
Mammal 91.4
Pet 91.4
Dog 91.4
Canine 91.4
Animal 91.4
Musician 85.6
Music Band 79.3
Furniture 78.4
Chair 78.4
Crowd 62.5
Person 61.9
Performer 59.5
Guitarist 59.5
Banjo 57.8

Imagga
created on 2022-02-26

man 37.6
people 31.7
percussion instrument 28.9
male 28.3
musical instrument 27.3
person 24.9
home 23.9
senior 23.4
kin 22.3
happy 19.4
adult 19.3
mature 18.6
couple 17.4
room 17.1
nurse 16.8
men 16.3
elderly 16.3
family 16
uniform 14.2
steel drum 14.1
old 13.9
smiling 13.7
sitting 13.7
lifestyle 13.7
professional 13.3
medical 13.2
care 13.1
portrait 12.9
patient 12.4
together 12.2
hospital 12.2
smile 12.1
group 12.1
drum 12
women 11.8
worker 11.8
health 11.8
business 11.5
indoors 11.4
team 10.7
retired 10.6
cheerful 10.6
retirement 10.5
happiness 10.2
horizontal 10
interior 9.7
businessman 9.7
table 9.5
talking 9.5
meeting 9.4
work 9.4
day 9.4
casual 9.3
camera 9.2
holding 9.1
human 9
working 8.8
half length 8.8
kettle 8.7
love 8.7
clothing 8.6
two 8.5
indoor 8.2
outdoors 8.2
businesswoman 8.2
office 8.1
mother 8.1
looking 8
celebration 8
to 8
70s 7.9
casual clothing 7.8
color 7.8
discussion 7.8
two people 7.8
older 7.8
30s 7.7
married 7.7
husband 7.6
wife 7.6
laughing 7.6
help 7.4
teamwork 7.4
20s 7.3
aged 7.2
decoration 7.2
teacher 7.2
job 7.1
medicine 7

Google
created on 2022-02-26

Table 89.6
Black 89.5
Black-and-white 85.6
Style 84
Couch 77.7
Monochrome photography 76.2
Monochrome 75.2
Hat 74.7
Suit 74.1
Vintage clothing 74
Room 72.1
Chair 71.6
Window 71.2
Art 70.1
Event 68.9
Classic 68.4
Picture frame 68.2
Sitting 67.8
Coffee table 66.8
Motor vehicle 65.5

Microsoft
created on 2022-02-26

text 99.2
person 98.6
clothing 84.4
group 66.5
man 62.1
posing 50.1
shop 14.9

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 94.6%
Happy 98.4%
Surprised 0.5%
Disgusted 0.4%
Calm 0.4%
Sad 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.8%
Happy 89.6%
Calm 5.1%
Confused 2.3%
Sad 2.2%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 28-38
Gender Male, 70%
Happy 92.7%
Surprised 5.7%
Calm 0.5%
Angry 0.4%
Sad 0.2%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 85%
Surprised 51.9%
Calm 34.2%
Sad 7.5%
Fear 2%
Happy 1.6%
Confused 1.2%
Angry 1%
Disgusted 0.4%

AWS Rekognition

Age 43-51
Gender Male, 86.1%
Calm 69.9%
Happy 16.8%
Sad 6.4%
Confused 3.6%
Surprised 1.8%
Angry 0.8%
Disgusted 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Dog 91.4%

Captions

Microsoft

a group of people posing for a photo 93.5%
a group of people standing in front of a window 89.6%
a group of people posing for a photo in front of a window 88.4%

Text analysis

Amazon

14
MJ17--YT37A°--AX

Google

CU
CU