Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball, couple hugging and smiling)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15659.2

Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball, couple hugging and smiling)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Apparel 99.3
Clothing 99.3
Human 98.2
Face 98.2
Person 95.5
Female 94.7
Pants 88.6
Smile 88.4
Art 85.3
Painting 85.3
Plant 84.2
Woman 81.8
Dating 80.8
Tree 74.5
Coat 71.3
Sleeve 70.1
Dress 68.9
Girl 68.9
Photography 68.4
Photo 68.4
Portrait 68.4
Man 63.5
Laughing 61.8
Overcoat 60.4
Hug 60.1
Suit 59.3
Outdoors 57.9
Vase 57.5
Potted Plant 57.5
Pottery 57.5
Jar 57.5
Jeans 56.7
Denim 56.7
Urban 56.6
Jacket 56.1
Person 43.1

Imagga
created on 2022-02-05

art 18.8
old 15.3
vintage 15
design 14.7
drawing 14.6
container 14.2
card 13.6
frame 13.6
people 13.4
person 13.2
graphic 13.1
grunge 12.8
clothing 12.5
portrait 12.3
decoration 12
covering 11.7
envelope 11.5
paper 11.5
retro 11.5
adult 11.4
fashion 11.3
attractive 11.2
celebration 11.2
floral 11.1
blackboard 11
holiday 10.7
smile 10.7
elegant 10.3
pattern 10.3
elegance 10.1
happy 10
blond 9.8
antique 9.5
cute 9.3
pink 9.2
wallpaper 9.2
border 9
sexy 8.8
symbol 8.7
hair 8.7
spring 8.6
ornament 8.6
model 8.6
face 8.5
flower 8.5
black 8.4
texture 8.3
lips 8.3
traditional 8.3
silhouette 8.3
gold 8.2
sensuality 8.2
child 7.9
color 7.8
party 7.7
sketch 7.6
hairstyle 7.6
element 7.4
make 7.3
student 7.2
dress 7.2
creative 7.1
jacket 7.1

Google
created on 2022-02-05

Tints and shades 77.2
Art 76.7
Vintage clothing 74.9
Flash photography 74.3
Formal wear 74.1
Classic 72
Event 71.2
Fashion design 69.1
Font 68.9
Visual arts 66
Magenta 65.2
Rectangle 64.5
Room 63.8
Necklace 62.4
Peach 62.4
Jewellery 59.6
Hat 57.8
Tradition 56.4
Retro style 55.8
Photographic paper 55.3

Microsoft
created on 2022-02-05

text 98.2
person 89.2
clothing 87.2
human face 87.1
dance 85.5
girl 78
woman 77.3
bride 66.9
dress 59.1
wedding dress 55.9
smile 54.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 67.7%
Confused 21.5%
Angry 4.3%
Calm 2.6%
Disgusted 1.7%
Sad 1.1%
Fear 0.8%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 97.6%
Calm 1.6%
Surprised 0.3%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.5%
Painting 85.3%

Captions

Microsoft

a girl holding a book 45.7%
a young girl holding a book 27.5%
a close up of a girl holding a book 27.4%