Human Generated Data

Title

Untitled (Davies family Christmas card; three photos of family with captions)

Date

c. 1945

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17529

Human Generated Data

Title

Untitled (Davies family Christmas card; three photos of family with captions)

People

Artist: Lucian and Mary Brown, American

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Poster 100
Advertisement 100
Human 99
Person 99
Person 98.7
Person 98.1
Person 97.7
Person 97.1
Collage 96.8
Person 96.7
Person 96.7
Person 96.3
Person 95.1
Person 95.1
Face 93.4
Head 88.9
Brochure 85
Paper 85
Flyer 85
Photo Booth 82.6
Text 76.5
Photography 68
Photo 68
Portrait 68
Military 60
Officer 60
Military Uniform 60
Female 56.3
Sailor Suit 55

Imagga
created on 2022-02-26

web site 44.2
book jacket 34
jacket 27.4
blackboard 24.7
business 21.3
wrapping 20.1
currency 18.8
money 18.7
mail 17.2
man 16.8
paper 16.6
vintage 16.5
stamp 16.4
world wide web 15.9
postage 15.7
people 15.6
cash 15.5
old 15.3
bill 15.2
finance 15.2
postmark 14.8
person 14.7
letter 14.7
envelope 14.5
retro 13.9
banking 13.8
happy 13.8
male 13.5
covering 13.5
symbol 12.8
sign 12.8
postal 12.8
student 12.7
financial 12.5
dollar 12.1
office 12
mug shot 11.9
design 11.2
one 11.2
creation 11
philately 10.8
black 10.8
bank 10.7
photograph 10.4
aged 9.9
wealth 9.9
circa 9.9
printed 9.8
portrait 9.7
exchange 9.5
art 9.4
professional 9.4
grunge 9.4
card 9.3
smile 9.3
face 9.2
global 9.1
adult 9.1
market 8.9
group 8.9
hundred 8.7
education 8.7
post 8.6
blank 8.6
senior 8.4
modern 8.4
representation 8.4
investment 8.2
message 8.2
board 8.1
billboard 8.1
success 8
home 8
drawing 7.9
shows 7.9
work 7.8
chalkboard 7.8
ancient 7.8
dollars 7.7
culture 7.7
communications 7.7
college 7.6
hobby 7.6
savings 7.5
economy 7.4
note 7.3
product 7.3
comic book 7.2
smiling 7.2
looking 7.2
book 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 100
person 97.4
man 96.5
human face 95.3
clothing 95.1
poster 94
library 85
posing 83.5
newspaper 69.4
old 57.8
set 25.9

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 50.2%
Happy 28.3%
Sad 9.2%
Confused 3.9%
Surprised 2.8%
Disgusted 2.7%
Angry 2%
Fear 0.9%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 53%
Calm 18.1%
Surprised 7.4%
Sad 6.6%
Disgusted 5.4%
Confused 4.4%
Fear 3.6%
Angry 1.5%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 48%
Sad 25.8%
Happy 8.7%
Confused 6.9%
Angry 5%
Disgusted 2.7%
Surprised 2%
Fear 0.9%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 99.9%
Surprised 0%
Sad 0%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 90.2%
Calm 97.3%
Sad 1.2%
Surprised 0.6%
Disgusted 0.4%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 98.9%
Happy 58.3%
Calm 38.5%
Angry 1.1%
Sad 0.5%
Confused 0.5%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 72.1%
Sad 8.4%
Confused 7.2%
Surprised 5%
Disgusted 4.4%
Happy 1.8%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 69%
Calm 19%
Sad 7.8%
Angry 1.5%
Disgusted 0.8%
Surprised 0.8%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 34-42
Gender Female, 73.4%
Sad 47.4%
Calm 20.2%
Happy 14.5%
Confused 7.1%
Disgusted 6.2%
Fear 1.7%
Angry 1.5%
Surprised 1.4%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 88.5%
Sad 4%
Confused 3.1%
Happy 1.6%
Disgusted 1%
Angry 0.9%
Surprised 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 100%
Person 99%

Captions

Microsoft

a screen shot of a group of people posing for a photo 84.1%
a vintage photo of a group of people posing for the camera 74.5%
a vintage photo of a group of people posing for a picture 74.4%

Text analysis

Amazon

the
Bradley
family
Fulda,
HAPPY
Jr.
and
Fulda, Germany
Lake
Walter
Davies
Germany
Lake Minnetonka
Bradley University
the Walter H. Davies Jr. and family
HAPPY HOLIDAYS!
Minnetonka
University
HOLIDAYS!
H.
5
S.ARMY
MJI7--YT37A°--АX

Google

SARM
and
MJI7--YT3A°2--AO
HAPPY
!
H.
Davies
Jr.
MJI7--YT3A°2--AO SARM Fulda, Germany Bradley University Lake Minnetonka HAPPY HOLIDAYS ! the Walter H. Davies Jr. and family
University
Minnetonka
HOLIDAYS
the
Walter
family
Lake
Fulda,
Germany
Bradley