Human Generated Data

Title

Untitled (children playing with toys on couch)
Date

1957
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17505

Human Generated Data

Title

Untitled (children playing with toys on couch)

People

Artist: Lucian and Mary Brown, American

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17505

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.9
Chair 98.3
Person 95.5
Human 95.5
Person 95.4
Person 94.4
Clothing 94.3
Apparel 94.3
Living Room 93.5
Indoors 93.5
Room 93.5
Person 91
Person 90.8
Person 90.5
Person 83.6
Hat 80.4
Couch 69.5
Face 67.2
Bed 66.3
Portrait 65.4
Photography 65.4
Photo 65.4
Table 65.1
Cabinet 64
Flooring 60.8
Monitor 58.6
Electronics 58.6
Display 58.6
Screen 58.6
Home Decor 56.8
Person 56.7

Clarifai
created on 2023-10-29

people 99.9
adult 97.2
man 96.8
monochrome 96.6
woman 96.4
group 95.2
child 92.8
nostalgia 92.2
one 91.3
group together 91
two 91
chair 89.8
vehicle 89.6
furniture 89
indoors 88.3
several 86.4
recreation 86.4
wear 86.1
actress 86.1
retro 85.6

Imagga
created on 2022-02-26

home 28.7
room 28.1
person 26.2
people 25.1
man 23.6
sitting 21.4
indoors 21.1
interior 19.4
adult 19.3
male 18.5
laptop 17.8
happy 16.9
chair 16.9
house 16.7
table 16
smiling 15.2
computer 14.8
men 14.6
women 14.2
business 14
lifestyle 13
cheerful 13
indoor 12.8
modern 12.6
working 12.4
furniture 12.3
office 12.3
couch 11.6
smile 10.7
together 10.5
living 10.4
desk 10.4
meeting 10.4
work 9.9
team 9.8
businessman 9.7
happiness 9.4
blackboard 9.4
casual 9.3
bright 9.3
student 9.2
relaxing 9.1
iron lung 8.9
technology 8.9
couple 8.7
relaxed 8.4
finance 8.4
floor 8.4
leisure 8.3
holding 8.2
cup 8.2
fun 8.2
planner 8.1
looking 8
education 7.8
carpet 7.8
mid adult 7.7
pretty 7.7
30s 7.7
equipment 7.6
device 7.6
adults 7.6
enjoyment 7.5
screen 7.5
inside 7.4
book 7.3
design 7.3
group 7.2
domestic 7.2
respirator 7.1
portrait 7.1
family 7.1
love 7.1
professional 7.1

Google
created on 2022-02-26

Photograph 94.2
Picture frame 90.9
Black 89.7
Black-and-white 86.7
Mammal 85.7
Style 84.1
Chair 80.3
Monochrome 77.5
Monochrome photography 76.8
Art 76.2
Font 75.7
Snapshot 74.3
Building 73.4
Room 68.7
Visual arts 67.8
Event 66.9
Table 65.2
Sitting 64.2
Stock photography 62.9
History 62.8

Microsoft
created on 2022-02-26

indoor 94.7
drawing 83.6
bedroom 32.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 92.4%
Calm 68.9%
Happy 17.6%
Surprised 5%
Angry 2.7%
Disgusted 2.1%
Confused 2%
Sad 1.2%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Female, 61.3%
Happy 90%
Calm 3.9%
Sad 3.2%
Confused 0.9%
Fear 0.6%
Angry 0.5%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Happy 97.2%
Calm 1%
Fear 0.4%
Surprised 0.4%
Sad 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Couch
Person 95.5%
Person 95.4%
Person 94.4%
Person 91%
Person 90.8%
Person 90.5%
Person 83.6%
Person 56.7%
Hat 80.4%
Couch 69.5%

Captions

Microsoft
created on 2022-02-26

a person sitting on a bed 61.7%
a person sleeping on a bed 37.4%
a dog sitting on a bed 35.4%

Text analysis

Amazon

12.

Google

12.
12.