Human Generated Data

Title

Visual Autobiography

Date

c. 1975

People

Artist: Henry Holmes Smith, American 1909 - 1986

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Student Print Rental Program, P1976.63

Copyright

© Smith Family Trust

Human Generated Data

Title

Visual Autobiography

People

Artist: Henry Holmes Smith, American 1909 - 1986

Date

c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Advertisement 100
Poster 100
Collage 100
Person 99.2
Human 99.2
Person 98.6
Person 97.4
Person 93.5
Person 93.2
Overcoat 89.9
Suit 89.9
Clothing 89.9
Coat 89.9
Apparel 89.9
Person 88.7
Person 80.7
Person 78.8
Head 77.5
Art 62
Tie 58.7
Accessories 58.7
Accessory 58.7

Imagga
created on 2022-01-09

letterhead 30.8
paper 27.7
card 25.3
stationery 24
design 23.6
blank 23.1
business 20.6
creation 20.1
frame 18.1
mug shot 17.7
silhouette 17.4
black 16.9
symbol 16.8
writing paper 16.8
sign 16.5
web site 16.1
photograph 16.1
product 15.7
art 15.3
vintage 14.9
element 14.9
snapshot 14.7
template 14.7
representation 14.1
modern 14
decoration 13.7
collection 13.5
menu 13.3
banner 12.9
graphic 12.4
magazine 11.7
retro 11.5
floral 11.1
money 11.1
insulating material 10.8
style 10.4
shape 10.3
set 10.2
old 9.8
pattern 9.6
antique 9.5
poster 9.4
grunge 9.4
web 9.3
holiday 9.3
page 9.3
cover 9.2
letter 9.2
office 8.8
creative 8.8
drawing 8.8
layout 8.7
man 8.7
elegant 8.6
communication 8.4
presentation 8.4
decorative 8.3
gold 8.2
building material 8.1
happy 8.1
board 8.1
new 8.1
celebration 8
text 7.9
people 7.8
space 7.8
corporate 7.7
empty 7.7
elegance 7.6
person 7.5
holding 7.4
world 7.4
ornate 7.3
border 7.2
box 7.2
colorful 7.2
stamp 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

gallery 100
scene 99.5
room 99.4
drawing 98.1
sketch 94.7
text 92.9
posing 92.3
person 90.1
man 88.1
clothing 87.2
cartoon 83.4
human face 79.2
different 77
picture frame 76.5
black and white 68.9
art 63.4
bunch 52.8
various 46
old 45.1
painting 38
several 28.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Female, 97.4%
Sad 46.1%
Calm 37.9%
Confused 6%
Angry 3.1%
Fear 2.3%
Surprised 1.9%
Disgusted 1.7%
Happy 1.1%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Confused 43.8%
Calm 36.6%
Sad 9.2%
Angry 4%
Disgusted 2.2%
Happy 1.6%
Surprised 1.4%
Fear 1.2%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 95.2%
Happy 2.6%
Confused 0.8%
Sad 0.6%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 95.3%
Sad 3%
Angry 1%
Confused 0.3%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 99.7%
Calm 99.9%
Surprised 0%
Sad 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 66-76
Gender Male, 100%
Calm 92.9%
Happy 5.9%
Sad 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Female, 66.9%
Happy 95.4%
Calm 2.5%
Confused 0.7%
Surprised 0.5%
Disgusted 0.3%
Sad 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Happy 52.2%
Disgusted 33.7%
Sad 3.7%
Angry 3.3%
Surprised 2.5%
Fear 2.2%
Confused 1.3%
Calm 1%

AWS Rekognition

Age 26-36
Gender Male, 85.5%
Calm 39.6%
Surprised 28.2%
Disgusted 22.6%
Happy 4.6%
Angry 2.9%
Confused 1.4%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 83.6%
Happy 7.8%
Disgusted 3.4%
Surprised 1.9%
Sad 1.6%
Confused 1.2%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 6-14
Gender Female, 83.7%
Sad 74.4%
Calm 10.6%
Surprised 4.6%
Confused 4.3%
Angry 2.1%
Happy 1.9%
Disgusted 1.5%
Fear 0.6%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Suit 89.9%
Tie 58.7%

Captions

Microsoft

a painting of a man and a woman posing for a photo 30.4%

Text analysis

Amazon

AUTOBIOGRAPHY
Smith
Henry
Henry Holmes Smith
Holmes
1909
VISUAL AUTOBIOGRAPHY
VISUAL
BORN 1909 (OCT)
1910
BORN
(OCT)
age
1910 age 5 months
5 months

Google

(oCT)
Smith
5
AUTOBIOGRAPHY
BORN 1909 (oCT) Hemry Holumes Smith 1910 age 5 months Henry Holmes Smith VISUAL AUTOBIOGRAPHY
1909
Hemry
Holumes
Holmes
BORN
1910
age
months
Henry
VISUAL