Human Generated Data

Title

Untitled (family in living room with many puppies)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16885

Human Generated Data

Title

Untitled (family in living room with many puppies)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.2
Person 99.2
Home Decor 99.1
Furniture 99.1
Person 98.9
Person 97.5
Chair 96.8
Person 95.5
Person 93.9
Couch 93.1
Dog 93
Animal 93
Pet 93
Mammal 93
Canine 93
Indoors 91.9
Room 91.9
Living Room 91.9
Table 87.6
Food 83.4
Meal 83.4
People 80.5
Dish 77.2
Clothing 76.6
Apparel 76.6
Person 73.4
Person 71.4
Window 67.7
Building 67.4
Housing 67.4
Dining Table 67.4
Curtain 61.6
Icing 60.2
Cake 60.2
Creme 60.2
Cream 60.2
Dessert 60.2
Coffee Table 59.3
Pottery 58.5
Costume 58.4
Plant 57.8
Jar 57.8
Vase 57.8
Potted Plant 57.8
Cabinet 57
Baby 56.9
Dining Room 56.6
Bed 56.4
Hound 55.5

Imagga
created on 2022-02-26

iron lung 19.2
brass 19.1
glass 18.6
interior 16.8
decoration 16.1
table 16.1
device 15.6
respirator 15.3
home 15.1
room 15
wind instrument 14.7
luxury 14.6
celebration 14.3
chair 14.1
people 13.9
wedding 13.8
party 13.7
man 13.6
person 13.1
setting 12.5
black 12
breathing device 11.7
musical instrument 11
dinner 10.9
restaurant 10.8
indoors 10.5
plate 10.3
elegant 10.3
lifestyle 10.1
portrait 9.7
bride 9.6
dining 9.5
wine 9.4
house 9.2
indoor 9.1
business 9.1
groom 9
romantic 8.9
banquet 8.8
reception 8.8
napkin 8.8
love 8.7
clothing 8.7
fork 8.6
gift 8.6
adult 8.5
male 8.5
modern 8.4
elegance 8.4
life 8.3
drink 8.3
service 8.3
event 8.3
romance 8
decor 8
bright 7.9
wed 7.9
day 7.8
sitting 7.7
knife 7.7
cup 7.5
glasses 7.4
cheerful 7.3
new 7.3
metal 7.2
kitchen 7.2
science 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 98.5
text 98.2
window 94.9
indoor 91.5
table 84.8
vase 70.1
wedding dress 67.6
clothing 62.4
wedding cake 58.7
candle 58.7
old 48

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 93.7%
Calm 95.7%
Confused 2%
Sad 0.8%
Disgusted 0.6%
Surprised 0.2%
Angry 0.2%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Female, 97.1%
Calm 72.4%
Sad 25.1%
Happy 0.9%
Confused 0.5%
Surprised 0.5%
Angry 0.3%
Fear 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Dog 93%

Captions

Microsoft

a group of people sitting at a table 84.9%
a group of people sitting at a table with a cake 69.2%
a group of people sitting around a table 69.1%

Text analysis

Amazon

7
KODAK-A-EITW

Google

--YT3
-
2
MJI
A
°
MJIㅋ--YT3ㅋA°2 -