Human Generated Data

Title

Untitled (family portrait in front of house; Christmas card)

Date

1960

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17915

Human Generated Data

Title

Untitled (family portrait in front of house; Christmas card)

People

Artist: Lucian and Mary Brown, American

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Home Decor 100
Person 99.4
Human 99.4
Person 99.2
Person 99
Person 99
Person 98
Person 97.7
Countryside 92.2
Outdoors 92.2
Rural 92.2
Shelter 92.2
Building 92.2
Nature 92.2
Housing 90.6
Window 88.9
Advertisement 85.1
Poster 85.1
Apparel 80.4
Shorts 80.4
Clothing 80.4
Female 78.1
Curtain 74.6
Window Shade 74.6
People 74.1
Face 74
Child 69.2
Kid 69.2
Cake 68.1
Creme 68.1
Dessert 68.1
Cream 68.1
Icing 68.1
Food 68.1
Shutter 67.3
House 66.8
Woman 66.2
Teen 66.2
Blonde 66.2
Girl 66.2
Urban 57.8
Neighborhood 57.8
Villa 57.6
Dress 57
Furniture 56.5
Chair 56.5
Text 56.2

Imagga
created on 2022-03-04

barbershop 97.2
shop 82.6
mercantile establishment 63.3
place of business 42.2
house 35.9
building 35.7
architecture 32.9
window 29.4
door 25
old 24.4
wall 21.4
establishment 21.1
home 20.7
structure 20.7
windows 16.3
residential 14.3
exterior 13.8
street 13.8
residence 13.6
entrance 13.5
brick 13.3
urban 13.1
ancient 13
travel 12.7
city 12.5
glass 11.7
vintage 11.6
tourism 11.5
new 11.3
town 11.1
stone 11
frame 10.9
decoration 10.8
retro 10.6
architectural 10.6
construction 10.3
design 10.1
estate 9.5
outside 9.4
historical 9.4
grunge 9.4
balcony 9.2
historic 9.2
art 9.2
office 9
history 8.9
dwelling 8.8
property 8.7
roof 8.6
buildings 8.5
modern 8.4
facade 8.4
texture 8.3
aged 8.1
dirty 8.1
detail 8
room 7.9
shutter 7.9
people 7.8
space 7.7
culture 7.7
sky 7.6
outdoor 7.6
lamp 7.6
traditional 7.5
iron 7.5
outdoors 7.5
life 7.3
facility 7.3

Google
created on 2022-03-04

Window 94.8
Building 94.8
Photograph 94.2
Black-and-white 85.5
Style 84
Handwriting 82.3
Line 81.7
Font 78.9
Facade 76.4
Monochrome 75.9
Snapshot 74.3
Rectangle 73.8
Monochrome photography 73.6
Art 72.1
Room 68.8
Design 68.3
Door 68
Suit 67.4
Stock photography 64.3
Visual arts 63.8

Microsoft
created on 2022-03-04

text 99.6
house 91.9
window 87.6
clothing 70.7
person 69.4
wedding 59.2

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 54.8%
Happy 64.3%
Fear 25.1%
Calm 3.8%
Sad 3.4%
Angry 1.3%
Disgusted 1.2%
Confused 0.6%
Surprised 0.4%

AWS Rekognition

Age 40-48
Gender Female, 88.1%
Happy 58.4%
Calm 38%
Confused 1.3%
Fear 0.7%
Surprised 0.6%
Disgusted 0.4%
Sad 0.4%
Angry 0.2%

AWS Rekognition

Age 33-41
Gender Male, 91.1%
Calm 90.2%
Happy 4.9%
Angry 1.6%
Confused 1.4%
Disgusted 0.8%
Sad 0.6%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 84.4%
Calm 52.1%
Sad 41.8%
Happy 2.8%
Fear 1.3%
Angry 1.3%
Disgusted 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 36-44
Gender Male, 93.3%
Happy 64.2%
Calm 32%
Sad 1.3%
Fear 1%
Surprised 0.5%
Confused 0.4%
Disgusted 0.4%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 85.1%

Captions

Microsoft

a person standing in front of a store window 56.3%
a person standing in front of a store window 46.9%
a person standing in front of a window 46.8%

Text analysis

Amazon

the
23
from
1959
Plants
Christmas
meny Christmas 1959 from the Plants
meny

Google

meny
23
Chrismas
-
23 meny Chrismas from the Plants 1959 MJI7--YT 37A°2 - - XAGON
from
the
Plants
1959
MJI7--YT
37A°2
XAGON