Human Generated Data

Title

Visual Autobiography
Date

c. 1975
People

Artist: Henry Holmes Smith, American 1909 - 1986
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Student Print Rental Program, P1976.63
Copyright

© Smith Family Trust

Human Generated Data

Title

Visual Autobiography

People

Artist: Henry Holmes Smith, American 1909 - 1986

Date

c. 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Student Print Rental Program, P1976.63

Copyright

© Smith Family Trust

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Collage 100
Advertisement 100
Poster 100
Person 99.2
Human 99.2
Person 98.6
Person 97.4
Person 93.5
Person 93.2
Suit 89.9
Clothing 89.9
Coat 89.9
Overcoat 89.9
Apparel 89.9
Person 88.7
Person 80.7
Person 78.8
Head 77.5
Art 62
Tie 58.7
Accessories 58.7
Accessory 58.7

Clarifai
created on 2023-10-25

people 99.9
group 99.5
woman 98.9
adult 98.9
portrait 98.9
monochrome 98.7
collage 98.3
man 97.9
leader 94.3
chair 91.8
paper 89.8
art 89.7
many 89.6
print 87.7
retro 87.3
wear 87.1
one 87.1
set 86.7
collection 86.7
two 85.2

Imagga
created on 2022-01-09

letterhead 30.8
paper 27.7
card 25.3
stationery 24
design 23.6
blank 23.1
business 20.6
creation 20.1
frame 18.1
mug shot 17.7
silhouette 17.4
black 16.9
symbol 16.8
writing paper 16.8
sign 16.5
web site 16.1
photograph 16.1
product 15.7
art 15.3
vintage 14.9
element 14.9
snapshot 14.7
template 14.7
representation 14.1
modern 14
decoration 13.7
collection 13.5
menu 13.3
banner 12.9
graphic 12.4
magazine 11.7
retro 11.5
floral 11.1
money 11.1
insulating material 10.8
style 10.4
shape 10.3
set 10.2
old 9.8
pattern 9.6
antique 9.5
poster 9.4
grunge 9.4
web 9.3
holiday 9.3
page 9.3
cover 9.2
letter 9.2
office 8.8
creative 8.8
drawing 8.8
layout 8.7
man 8.7
elegant 8.6
communication 8.4
presentation 8.4
decorative 8.3
gold 8.2
building material 8.1
happy 8.1
board 8.1
new 8.1
celebration 8
text 7.9
people 7.8
space 7.8
corporate 7.7
empty 7.7
elegance 7.6
person 7.5
holding 7.4
world 7.4
ornate 7.3
border 7.2
box 7.2
colorful 7.2
stamp 7

Google
created on 2022-01-09

Photograph 94.2
Facial expression 93.3
White 92.2
Picture frame 91.4
Black 89.7
Human 89.7
Black-and-white 86.6
Art 84.5
Style 84.1
Font 83.9
Monochrome photography 75.9
Monochrome 74.1
Room 71.3
Visual arts 71.1
Event 70.1
History 66.9
Photograph album 66.1
Stock photography 65.2
Photographic paper 63.9
Collection 62.4

Microsoft
created on 2022-01-09

gallery 100
scene 99.5
room 99.4
drawing 98.1
sketch 94.7
text 92.9
posing 92.3
person 90.1
man 88.1
clothing 87.2
cartoon 83.4
human face 79.2
different 77
picture frame 76.5
black and white 68.9
art 63.4
bunch 52.8
various 46
old 45.1
painting 38
several 28.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Female, 97.4%
Sad 46.1%
Calm 37.9%
Confused 6%
Angry 3.1%
Fear 2.3%
Surprised 1.9%
Disgusted 1.7%
Happy 1.1%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Confused 43.8%
Calm 36.6%
Sad 9.2%
Angry 4%
Disgusted 2.2%
Happy 1.6%
Surprised 1.4%
Fear 1.2%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 95.2%
Happy 2.6%
Confused 0.8%
Sad 0.6%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 95.3%
Sad 3%
Angry 1%
Confused 0.3%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 99.7%
Calm 99.9%
Surprised 0%
Sad 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 66-76
Gender Male, 100%
Calm 92.9%
Happy 5.9%
Sad 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Female, 66.9%
Happy 95.4%
Calm 2.5%
Confused 0.7%
Surprised 0.5%
Disgusted 0.3%
Sad 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Happy 52.2%
Disgusted 33.7%
Sad 3.7%
Angry 3.3%
Surprised 2.5%
Fear 2.2%
Confused 1.3%
Calm 1%

AWS Rekognition

Age 26-36
Gender Male, 85.5%
Calm 39.6%
Surprised 28.2%
Disgusted 22.6%
Happy 4.6%
Angry 2.9%
Confused 1.4%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 83.6%
Happy 7.8%
Disgusted 3.4%
Surprised 1.9%
Sad 1.6%
Confused 1.2%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 6-14
Gender Female, 83.7%
Sad 74.4%
Calm 10.6%
Surprised 4.6%
Confused 4.3%
Angry 2.1%
Happy 1.9%
Disgusted 1.5%
Fear 0.6%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Tie
Person 99.2%
Person 98.6%
Person 97.4%
Person 93.5%
Person 93.2%
Person 88.7%
Person 80.7%
Person 78.8%
Suit 89.9%
Tie 58.7%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2022-01-09

a painting of a man and a woman posing for a photo 30.4%

Text analysis

Amazon

AUTOBIOGRAPHY
Smith
Henry
Henry Holmes Smith
Holmes
1909
VISUAL AUTOBIOGRAPHY
VISUAL
BORN 1909 (OCT)
1910
BORN
(OCT)
age
1910 age 5 months
5 months

Google

BORN 1909 (oCT) Hemry Holumes Smith 1910 age 5 months Henry Holmes Smith VISUAL AUTOBIOGRAPHY
BORN
1909
(oCT)
Hemry
Holumes
Smith
1910
age
5
months
Henry
Holmes
VISUAL
AUTOBIOGRAPHY