Human Generated Data

Title

Untitled (family portrait with many dogs and puppies)
Date

1962
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17871

Human Generated Data

Title

Untitled (family portrait with many dogs and puppies)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17871

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Person 98.7
Furniture 98.2
Home Decor 97.2
Person 96.3
Person 94.7
Dog 94.1
Mammal 94.1
Animal 94.1
Canine 94.1
Pet 94.1
Dining Table 91.5
Table 91.5
Chair 89.8
Person 86.7
Meal 86.4
Food 86.4
Indoors 83.9
Room 80.4
Dining Room 74.1
Dish 71
Tablecloth 65.6
People 64.3
Couch 63.1
Pottery 61
Flower 60.1
Plant 60.1
Blossom 60.1
Bed 57.6
Restaurant 55.2

Clarifai
created on 2023-10-29

people 99.9
group 99.4
man 97.9
group together 97.8
adult 97.2
woman 96.4
many 96
child 95.5
several 91
monochrome 90.6
boy 88.9
leader 87.6
five 82.9
music 82.7
administration 82.7
sit 82.1
furniture 81.9
indoors 81.3
family 80.2
education 78.8

Imagga
created on 2022-02-26

people 27.9
table 27.5
room 25.1
person 24.1
home 22.3
indoors 21.9
man 20.8
adult 20
kin 19.3
interior 17.7
women 16.6
party 16.3
male 16.3
dinner 16.2
lifestyle 15.9
glass 14.9
men 14.6
smiling 14.5
happy 14.4
restaurant 14.1
chair 14
cheerful 13.8
sitting 13.7
couple 13.1
work 12.6
setting 12.5
salon 12.3
senior 12.2
celebration 12
banquet 11.9
luxury 11.1
elegant 11.1
wedding 11
portrait 11
indoor 11
reception 10.8
china 10.4
love 10.2
wine 10.2
house 10
holding 9.9
kitchen 9.8
family 9.8
health 9.7
business 9.7
medical 9.7
lunch 9.6
fork 9.6
elderly 9.6
talking 9.5
mature 9.3
smile 9.3
event 9.2
office 9
team 9
working 8.8
napkin 8.8
food 8.8
together 8.8
flowers 8.7
knife 8.6
mother 8.6
dining 8.6
porcelain 8.5
meeting 8.5
tabletop 8.4
modern 8.4
horizontal 8.4
glasses 8.3
worker 8.3
dress 8.1
classroom 8.1
plate 8
professional 8
decor 8
clinic 7.9
patient 7.9
day 7.8
attractive 7.7
old 7.7
two 7.6
hand 7.6
desk 7.6
fashion 7.5
drink 7.5
meal 7.5
teamwork 7.4
service 7.4
decoration 7.3
group 7.2
hospital 7.2
face 7.1
businessman 7.1
happiness 7

Google
created on 2022-02-26

Black 89.6
Black-and-white 86.9
Table 85.7
Style 84.1
Monochrome 78.3
Monochrome photography 77.3
Suit 75
Snapshot 74.3
Chair 74
Vintage clothing 71.1
Event 69.8
Art 69.5
Tableware 69.4
Room 68.4
Stock photography 65.9
Plate 64.4
Classic 62.2
History 61.9
Sitting 61.7
Picture frame 61.2

Microsoft
created on 2022-02-26

text 98.8
person 96.8
window 89.2
table 89.2
clothing 74.7
group 62.6
man 58.2
furniture 53.4
vase 52.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 92%
Happy 95.2%
Calm 1.7%
Confused 1.1%
Surprised 0.5%
Disgusted 0.4%
Fear 0.4%
Sad 0.4%
Angry 0.3%

AWS Rekognition

Age 27-37
Gender Male, 67.8%
Surprised 46.9%
Calm 29.9%
Happy 16.7%
Sad 2.5%
Angry 1.1%
Fear 1.1%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 50-58
Gender Male, 93%
Happy 74.2%
Sad 12.7%
Confused 10.3%
Calm 1%
Disgusted 0.8%
Surprised 0.4%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 45-53
Gender Male, 69.9%
Happy 98.7%
Calm 0.6%
Confused 0.3%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 41-49
Gender Male, 63.2%
Happy 80.5%
Calm 14.3%
Sad 3.3%
Confused 0.6%
Angry 0.5%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog
Person 99.7%
Person 98.7%
Person 96.3%
Person 94.7%
Person 86.7%
Dog 94.1%

Categories

Imagga

people portraits 67.4%
interior objects 20.6%
paintings art 8.4%
pets animals 1.4%
food drinks 1.2%

Text analysis

Amazon

2

Google

2 MJI7--Y T 37A°2- - XAGON
2
MJI7--Y
T
37A°2-
-
XAGON