Human Generated Data

Title

Untitled (Davies family Christmas card; four images of family with text)
Date

1964
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16769

Human Generated Data

Title

Untitled (Davies family Christmas card; four images of family with text)

People

Artist: Lucian and Mary Brown, American

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Advertisement 99.6
Poster 99.4
Person 99.4
Human 99.4
Collage 98.8
Person 98
Person 96.4
Person 95.1
Person 94.3
Paper 93.4
Brochure 93.4
Flyer 93.4
Person 92
Person 85.6
Person 83.7
Person 71
Text 69.8
Person 66.4
Person 64.8
Art 64.4

Imagga
created on 2022-02-26

jacket 100
book jacket 100
wrapping 77.6
covering 54.2
vintage 35.7
paper 26.7
old 26.5
stamp 26.2
retro 25.4
mail 23.9
letter 23.8
envelope 22.6
postage 20.6
postmark 19.7
art 17.6
post 17.2
grunge 17
frame 16.8
texture 16.7
money 16.2
business 15.8
printed 15.7
antique 15.6
design 14.6
blank 14.6
aged 14.5
symbol 14.1
postal 13.7
cash 13.7
global 13.7
product 13.3
note 12.9
currency 12.6
sign 12
circa 11.8
stamps 11.8
book 11.8
collection 11.7
bill 11.4
unique 11.4
newspaper 11.3
banking 11
border 10.9
shows 10.8
black 10.8
bank 10.7
creation 10.6
cutting 10.6
communications 10.5
office 10.4
style 10.4
ancient 10.4
dollar 10.2
card 10.2
finance 10.1
message 10
philately 9.9
drawing 9.6
united 9.5
graphic 9.5
empty 9.4
dirty 9
one 9
paintings 8.8
icon 8.7
notes 8.6
culture 8.5
page 8.4
cover 8.3
pattern 8.2
paint 8.1
financial 8
post mail 7.9
zigzag 7.9
renaissance 7.9
text 7.9
delivery 7.8
museum 7.8
states 7.7
dollars 7.7
container 7.6
exchange 7.6
painted 7.6
fine 7.6
damaged 7.6
communication 7.6
savings 7.5
document 7.4
close 7.4
wealth 7.2
market 7.1

Google
created on 2022-02-26

Black 89.5
Style 84
Black-and-white 83.9
Picture frame 83.3
Font 81.7
Art 78.1
Monochrome photography 76.5
Monochrome 74.3
Sports uniform 68.6
Rectangle 65.8
Visual arts 65.3
Room 64.9
Stock photography 63.2
Elbow 58.2
Darkness 53.6
Still life photography 52.2
Photographic paper 51.6

Microsoft
created on 2022-02-26

text 99.9
person 96.8
poster 93.7
clothing 89.4
gallery 80.6
posing 73.7
white 64.9
old 62.4
cartoon 61.7
book 59.5
room 43.1
painting 17.3

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 97.3%
Calm 62.5%
Sad 23.9%
Happy 6.5%
Confused 5.7%
Surprised 0.6%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 45-53
Gender Male, 98.3%
Sad 48%
Happy 24.2%
Calm 22.8%
Confused 1.6%
Surprised 1.6%
Angry 0.7%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 39-47
Gender Male, 92.5%
Calm 98.2%
Sad 1.1%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 39.5%
Sad 35%
Surprised 7.1%
Happy 6.3%
Disgusted 4.4%
Confused 3.4%
Fear 2.3%
Angry 2%

AWS Rekognition

Age 29-39
Gender Male, 94.6%
Disgusted 89%
Confused 3.4%
Calm 3.2%
Sad 1.8%
Surprised 0.8%
Happy 0.7%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 36-44
Gender Male, 98.1%
Sad 91.7%
Confused 4.6%
Calm 1.4%
Disgusted 0.6%
Surprised 0.5%
Happy 0.5%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 24-34
Gender Male, 99.4%
Calm 37.5%
Sad 26.4%
Confused 19%
Happy 7.6%
Surprised 4.3%
Disgusted 1.9%
Angry 1.7%
Fear 1.6%

AWS Rekognition

Age 33-41
Gender Female, 55%
Happy 92.6%
Calm 2%
Sad 1.8%
Fear 1.4%
Disgusted 1.1%
Surprised 0.6%
Angry 0.4%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.4%
Person 99.4%

Captions

Microsoft

a painting of a person 66.4%
a painting of a person 62.8%
an old photo of a person 62.3%

Text analysis

Amazon

Happy
Family
Jr.,
Mrs.
New
Davies
Walter
Merry
Merry Christmas
Christmas
H
Happy New year
Mr. Y Mrs. Walter H Davies Jr., + Family
Y
year
+
Mr.

Google

MJI7--YT3RA°2--A0 Werry ChrisTmas Happy ew Gear Me 4 Mrs. Walter H Dovies Jr, + family
Werry
ChrisTmas
Walter
+
ew
Me
MJI7--YT3RA°2--A0
Mrs.
H
Happy
Gear
Dovies
Jr,
family
4