Human Generated Data

Title

Untitled (portrait of group sitting on beach with chairs and umbrella)

Date

early 20th Century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.16213

Human Generated Data

Title

Untitled (portrait of group sitting on beach with chairs and umbrella)

People

Artist: Unidentified Artist,

Date

early 20th Century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.16213

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.2
Human 99.2
Person 98.7
Person 97.3
Person 95.5
Furniture 91.3
Text 78.1
Person 76.6
Painting 72.6
Art 72.6
Advertisement 63.1
Poster 59.8
Collage 58.7

Clarifai
created on 2023-10-27

people 98.9
art 95.8
adult 95.6
wear 94.8
woman 94.2
vintage 94.1
retro 94
old 90.8
painting 88.4
group 88.3
paper 86.3
antique 86.2
portrait 85.9
leader 85.8
man 82
album 79.7
picture frame 78.4
furniture 78.1
illustration 77.1
book bindings 76.6

Imagga
created on 2022-01-29

vintage 49.7
old 47.4
grunge 46.8
paper 46.4
retro 41.8
ancient 38.9
antique 38.2
texture 37.5
aged 36.2
empty 27.5
blank 26.6
material 25
parchment 24
dirty 23.5
damaged 22.9
wallpaper 22.2
decay 22.2
frame 21
worn 21
page 20.4
border 19.9
crumpled 19.4
document 18.6
grime 18.6
grain 18.5
letter 18.3
design 18
grave 17.9
sheet 17.9
cardboard 17.3
pattern 17.1
brown 16.9
book 16.5
art 16.5
rough 16.4
stained 16.4
newspaper 15.9
ragged 15.6
fracture 15.6
stains 15.6
backgrounds 15.4
panel 15.4
old fashioned 15.2
grungy 15.2
canvas 15.2
textured 14.9
historic 14.7
decorative 14.2
wall 14
space 14
money 13.6
torn 13.5
aging 13.4
structure 13.2
backdrop 13.2
note 12.9
crease 12.7
manuscript 12.7
mottled 12.7
burnt 12.6
product 12.6
currency 12.6
graphic 12.4
daily 12.4
text 12.2
card 11.9
faded 11.7
history 11.6
crack 11.6
spot 11.5
envelope 11.1
cash 11
tracery 10.9
obsolete 10.5
creation 10.5
element 9.9
bank 9.9
shabby 9.8
surface 9.7
decoration 9.7
edge 9.6
dirt 9.6
age 9.5
rusty 9.5
bill 9.5
finance 9.3
banking 9.2
broad 8.8
pages 8.8
succulent 8.7
stamp 8.7
weathered 8.6
textures 8.5
business 8.5
cover 8.3
postage 7.9
scratched 7.8
sepia 7.8
stain 7.7
mail 7.7
post 7.6
savings 7.5
dollar 7.4
color 7.2
covering 7.2
studio couch 7.2
sofa 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 97.4
text 93.7
clothing 93.2
human face 81.5
old 78.3
newspaper 65.3
painting 33.2
stone 9.3
picture frame 8.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 60.4%
Calm 12.9%
Sad 10.6%
Confused 6.6%
Fear 3.4%
Disgusted 2.8%
Surprised 2.4%
Angry 0.8%

AWS Rekognition

Age 39-47
Gender Female, 100%
Happy 98.3%
Surprised 0.3%
Fear 0.3%
Calm 0.3%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 51-59
Gender Female, 99.2%
Happy 72.2%
Angry 6.8%
Disgusted 5.3%
Fear 3.7%
Calm 3.5%
Sad 3.1%
Surprised 3%
Confused 2.4%

AWS Rekognition

Age 41-49
Gender Male, 99.7%
Happy 99.6%
Disgusted 0.1%
Surprised 0.1%
Calm 0.1%
Angry 0%
Sad 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 6-16
Gender Female, 100%
Calm 60.4%
Angry 32.4%
Surprised 1.9%
Fear 1.4%
Sad 1.4%
Confused 1%
Happy 0.9%
Disgusted 0.6%

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.2%
Person 98.7%
Person 97.3%
Person 95.5%
Person 76.6%
Painting 72.6%

Categories

Captions

Microsoft
created on 2022-01-29

a vintage photo of a painting 72.3%
a painting of a person 72.2%
a vintage photo of a person 72.1%

Text analysis

Amazon

U.S.A

Google

VICTORY U.SA
VICTORY
U.SA