Human Generated Data

Title

Untitled (Davies family Christmas card; five images of family with text)

Date

1964

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16770

Human Generated Data

Title

Untitled (Davies family Christmas card; five images of family with text)

People

Artist: Lucian and Mary Brown, American

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Advertisement 100
Poster 100
Collage 99.5
Human 99.2
Person 99.2
Person 97.9
Person 97.5
Person 97.1
Person 95.8
Person 93.7
Person 92.4
Person 91.8
Person 89.9
Brochure 87.6
Flyer 87.6
Paper 87.6
Person 83.6
Text 69.2
Person 67.1
Art 62.8
Person 58.4
Person 44.9

Imagga
created on 2022-02-26

book jacket 88.7
jacket 69
wrapping 52.4
covering 36.6
comic book 35.9
vintage 24
old 20.2
stamp 18.4
postmark 17.7
letter 17.4
mail 17.2
retro 17.2
card 17
envelope 17
paper 16.5
art 15.6
aged 15.4
postage 14.7
grunge 14.5
money 14.5
print media 14.4
currency 14.3
postal 13.7
post 13.3
business 12.1
antique 12.1
philately 11.8
slick 11.5
symbol 11.4
ancient 11.2
cash 11
house 10.9
printed 10.8
black 10.2
dollar 10.2
drawing 10.1
shows 9.8
office 9.6
design 9.6
bill 9.5
message 9.1
bank 9
circa 8.9
communications 8.6
wall 8.5
poster 8.5
frame 8.4
window 8.4
texture 8.3
sport 8.2
one 8.2
global 8.2
hundred 7.7
dollars 7.7
product 7.7
finance 7.6
unique 7.6
sign 7.5
technology 7.4
man 7.4
banking 7.3
note 7.3
paint 7.2
detail 7.2
icon 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.7
cartoon 95.6
person 95.4
poster 94.9
clothing 89.5
book 89.4
drawing 77.4
gallery 69.6
blackboard 68.7
sign 66.2
newspaper 65.4
picture frame 58.1
black and white 51.6
posing 45.8
painting 19

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Calm 96%
Happy 2.7%
Sad 0.6%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Female, 65.9%
Sad 90.5%
Calm 4.9%
Happy 3.1%
Confused 0.7%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 87.3%
Sad 54.8%
Calm 33.6%
Disgusted 2.8%
Happy 2.7%
Fear 2.5%
Confused 1.8%
Angry 1%
Surprised 0.8%

AWS Rekognition

Age 40-48
Gender Male, 98.6%
Happy 42.7%
Sad 33.6%
Calm 17.5%
Confused 5%
Surprised 0.4%
Disgusted 0.4%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 27-37
Gender Male, 98.5%
Sad 57.2%
Calm 25.2%
Confused 6.9%
Happy 5.9%
Angry 1.4%
Disgusted 1.3%
Surprised 1.2%
Fear 0.9%

AWS Rekognition

Age 39-47
Gender Male, 93.8%
Sad 51.4%
Angry 20.7%
Happy 11.2%
Calm 8.4%
Disgusted 3.4%
Confused 2.4%
Fear 1.4%
Surprised 1.1%

AWS Rekognition

Age 26-36
Gender Male, 97.9%
Angry 73.7%
Happy 8.5%
Surprised 6.8%
Sad 4.6%
Calm 3.7%
Fear 1.2%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 78.1%
Sad 12.6%
Happy 3.3%
Surprised 2.1%
Fear 1.5%
Confused 1%
Angry 0.9%
Disgusted 0.4%

AWS Rekognition

Age 23-31
Gender Male, 94.9%
Calm 79.4%
Sad 14.6%
Happy 2%
Fear 1.4%
Surprised 0.9%
Confused 0.6%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 26-36
Gender Male, 95.5%
Calm 65.1%
Confused 10.6%
Disgusted 9.8%
Sad 9.6%
Happy 1.9%
Fear 1.8%
Surprised 0.7%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 100%
Person 99.2%

Captions

Microsoft

a blackboard sign next to a painting 63.6%
a blackboard sign next to a painting on the wall 55.7%
a blackboard sign in front of a television 55%

Text analysis

Amazon

Davies,
Family
Walter
H.
MR. f MRS. Walter H. Davies, JR., Family
MRS.
JR.,
MR.
f
KOOOK

Google

711R.
+
JR,
A
Walter
VT A NAGO 711R. + 7RS. Walter H Davies, JR, ri
VT
NAGO
Davies,
ri
7RS.
H