Human Generated Data

Title

"Tooth Drawing, Out at Last" (2)

Date

19th-20th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.136

Human Generated Data

Title

"Tooth Drawing, Out at Last" (2)

People

Artist: Unidentified Artist,

Date

19th-20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.136

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 96.8
Human 96.8
Person 95.8
Clothing 92.5
Apparel 92.5
Person 91.7
Person 91.1
Person 83.8
Collage 80.7
Advertisement 80.7
Poster 80.7
Person 78.3
Furniture 78.1
Wood 76.1
Clock Tower 66.4
Building 66.4
Architecture 66.4
Tower 66.4
Face 64.1
Female 63.5
Chair 62.3
Girl 61.2
Living Room 59.8
Indoors 59.8
Room 59.8
Person 58.5
Person 56.3
Shoe 55.1
Footwear 55.1
Shelf 55

Clarifai
created on 2023-10-26

people 98.9
street 98
woman 97.2
girl 93.3
adult 93.2
shopping 93
market 91.1
family 88.9
child 88.8
commerce 88.7
group 88.6
wear 87.4
man 86.9
stock 85.5
art 84.9
sit 84
sale 80.7
furniture 80.6
book bindings 80.6
portrait 80.5

Imagga
created on 2022-01-22

shop 63.4
shoe shop 54.7
mercantile establishment 39.2
place of business 26.1
currency 15.2
money 14.5
business 14
people 13.4
establishment 13
cash 12.8
market 12.4
fashion 12.1
sale 12
adult 11.7
store 11.3
happy 11.3
gift 11.2
chair 11.2
old 11.1
shopping 11
finance 11
bank 10.7
retail 10.4
basket 10.3
holiday 10
product 10
indoors 9.7
home 9.6
container 9.5
color 9.5
paper 9.4
smiling 9.4
bag 9.3
wicker 9.1
holding 9.1
hamper 9.1
wealth 9
person 8.9
cheerful 8.9
financial 8.9
room 8.9
interior 8.8
man 8.7
banknote 8.7
child 8.7
buy 8.5
city 8.3
vintage 8.3
one 8.2
present 8.2
happiness 7.8
banknotes 7.8
male 7.8
sitting 7.7
shoes 7.7
work 7.6
joy 7.5
window 7.5
clothing 7.5
savings 7.5
banking 7.4
rocking chair 7.3
colorful 7.2
women 7.1

Google
created on 2022-01-22

Photograph 94.2
Fashion 89.2
Textile 88.1
Interior design 85.4
Art 84.8
Community 81.8
Adaptation 79.4
Fashion design 74.8
Snapshot 74.3
Vintage clothing 73.3
Room 71.9
Painting 71
Shelf 70.2
Visual arts 70.1
Illustration 69.9
Sitting 64.6
Leisure 60.8
Collection 59.5
Retail 59.5
Machine 58.5

Microsoft
created on 2022-01-22

clothing 85
cartoon 84.9
person 84.4
text 79.8
furniture 75.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 91.8%
Disgusted 2.8%
Sad 2.4%
Confused 0.9%
Surprised 0.8%
Angry 0.6%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Calm 56.4%
Happy 21.5%
Sad 7.9%
Disgusted 5.9%
Confused 4.4%
Surprised 1.5%
Angry 1.4%
Fear 1%

AWS Rekognition

Age 40-48
Gender Female, 100%
Calm 51.4%
Angry 26.2%
Confused 5.1%
Disgusted 5%
Surprised 4.9%
Sad 4.4%
Fear 2.6%
Happy 0.5%

AWS Rekognition

Age 37-45
Gender Female, 99.9%
Calm 81.9%
Disgusted 4.6%
Angry 4.2%
Confused 4%
Sad 2.9%
Surprised 1.3%
Fear 1%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 53.7%
Surprised 24.3%
Confused 19.6%
Fear 15.1%
Disgusted 10.9%
Calm 9.9%
Sad 8.1%
Happy 7.1%
Angry 5%

AWS Rekognition

Age 20-28
Gender Female, 64.6%
Calm 59.3%
Happy 13.6%
Surprised 11%
Fear 10.5%
Disgusted 1.9%
Confused 1.5%
Angry 1.3%
Sad 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%
Clock Tower 66.4%

Categories

Imagga

paintings art 94.6%
interior objects 5.1%

Captions

Text analysis

Amazon

at
Dooth
2
No. 2
No.
last"
Dooth Drawing
"Out at last"
Drawing
"Out

Google

No.
2
Ont
at
No. 2 Ont at