Human Generated Data

Title

Untitled (Donaldson family Christmas card)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16977

Human Generated Data

Title

Untitled (Donaldson family Christmas card)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16977

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Poster 99.9
Advertisement 99.9
Person 99.7
Human 99.7
Person 99.3
Person 99.3
Person 99
Shop 91.8
Clothing 91.1
Apparel 91.1
Furniture 82.6
Person 78.8
Boutique 78.8
Person 76.1
Text 74.4
Room 71.6
Indoors 71.6
Tie 64.8
Accessories 64.8
Accessory 64.8
Window Display 59.8
Underwear 58.9
Lingerie 58.3
Collage 55.6

Clarifai
created on 2023-10-29

people 99.8
adult 97.6
group 96.8
woman 95.7
man 94.2
wear 92.7
veil 92.6
monochrome 92.5
retro 90
furniture 89.3
indoors 87.6
outfit 87.4
window 87.3
art 87
two 85.8
family 85.6
illustration 85.3
print 82.8
child 82.8
uniform 80.9

Imagga
created on 2022-03-12

web site 25
newspaper 24
product 22.2
art 21.3
book jacket 20.4
slick 19.6
creation 19.4
old 17.4
vintage 17.4
jacket 15.8
business 15.2
black 15
daily 14.5
billboard 13.4
symbol 12.8
man 12.8
structure 12.7
wrapping 12
film 12
money 11.9
history 11.6
financial 11.6
culture 11.1
grunge 11.1
architecture 10.9
signboard 10.8
postage 10.8
stamp 10.6
male 10.6
mail 10.5
historical 10.3
building 10.2
finance 10.1
design 10.1
historic 10.1
people 10
negative 10
paint 10
drawing 10
silhouette 9.9
currency 9.9
circa 9.9
postmark 9.9
retro 9.8
postal 9.8
sculpture 9.4
envelope 9.3
famous 9.3
letter 9.2
cash 9.2
city 9.1
person 9
printed 8.8
antique 8.7
travel 8.4
monument 8.4
savings 8.4
economy 8.3
banking 8.3
covering 8.3
office 8.2
tourism 8.2
bank 8.2
closeup 8.1
businessman 7.9
finances 7.7
card 7.6
chart 7.6
hand 7.6
house 7.5
human 7.5
frame 7.5
one 7.5
graphic 7.3
success 7.2
landmark 7.2
paper 7.1

Google
created on 2022-03-12

Coat 92.7
Picture frame 92.1
Black 89.7
Font 81.2
Suit 73.9
Display device 73.7
Monochrome photography 71.6
Art 71.5
Advertising 70.6
Room 69.2
Monochrome 69.1
T-shirt 67.9
Rectangle 67.3
Vintage clothing 66.9
Event 66.2
Formal wear 64.4
Stock photography 64.2
Visual arts 60.4
Photo caption 60
Photographic paper 59.3

Microsoft
created on 2022-03-12

text 100
wedding 92.9
poster 88.5
marriage 68.2
clothing 65.4
blackboard 63.7
billboard 62.3
person 54

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 92.2%
Happy 84.3%
Surprised 11.5%
Calm 1.7%
Sad 0.9%
Fear 0.7%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Happy 50.1%
Sad 23.4%
Calm 17.5%
Surprised 4.1%
Confused 1.8%
Disgusted 1.6%
Angry 0.9%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Female, 92.1%
Calm 61.1%
Happy 12.6%
Fear 6.4%
Sad 5.3%
Angry 5.2%
Surprised 4.8%
Confused 3.3%
Disgusted 1.4%

AWS Rekognition

Age 48-54
Gender Female, 62.2%
Calm 99.7%
Sad 0.1%
Disgusted 0%
Angry 0%
Surprised 0%
Happy 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster
Person
Tie
Poster 99.9%
Person 99.7%
Person 99.3%
Person 99.3%
Person 99%
Person 78.8%
Person 76.1%
Tie 64.8%

Categories

Imagga

paintings art 99.5%

Captions

Microsoft
created on 2022-03-12

a screen shot of a blackboard 69.5%
a blackboard near a monitor 43.2%
a screen shot of a television 34.3%

Text analysis

Amazon

It's
that
from
Christmas
Richard
Donaldson
the
Merry Christmas from the Richard Donaldson family!
family!
OOPS
It's that time again
again
Merry
time

Google

9t's that time again Morry Chaistmas fnom the Richand Donaldson family ! OOPS
9t's
that
time
again
Morry
Chaistmas
fnom
the
Richand
Donaldson
family
!
OOPS