Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball, Native American and Hawaiian costumes)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15658.1

Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball, Native American and Hawaiian costumes)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99.5
Person 99.5
Person 99.1
Person 98.8
Person 93.6
Clothing 91.3
Apparel 91.3
Person 89
Face 80.9
Costume 75.2
Floor 75.1
Plant 74.7
Flower 69.3
Blossom 69.3
Flooring 69.3
People 68.4
Person 68.2
Flower Arrangement 65.3
Toy 65.3
Female 65.3
Evening Dress 63.2
Gown 63.2
Robe 63.2
Fashion 63.2
Hula 59.4
Dress 59.4
Girl 59.1
Photo 58.8
Photography 58.8

Imagga
created on 2022-02-05

old 34.8
vintage 32.2
antique 30.5
grunge 28.9
retro 28.7
art 27.7
decoration 26.7
graffito 24.4
ancient 24.2
texture 22.9
paper 22.8
frame 21.6
design 21
aged 19.9
pattern 17.8
wall 16.6
decorative 15.9
material 15.2
structure 15.2
religion 14.3
flower 13.8
tray 13.4
graphic 13.1
border 12.7
temple 12.3
sculpture 12.3
wallpaper 12.2
culture 12
letter 11.9
brown 11.8
history 11.6
parchment 11.5
page 11.1
architecture 11
ornate 11
container 10.7
door 10.6
damaged 10.5
old fashioned 10.5
artistic 10.4
style 10.4
grain 10.1
historic 10.1
receptacle 10
paint 10
gold 9.9
travel 9.9
grime 9.8
fracture 9.7
decay 9.6
ornament 9.5
floral 9.4
church 9.3
traditional 9.1
decor 8.8
panel 8.8
crumpled 8.7
worn 8.6
card 8.5
blackboard 8.5
religious 8.4
covering 8.4
dirty 8.1
detail 8
ragged 7.8
faded 7.8
drawing 7.8
space 7.8
empty 7.7
blank 7.7
furniture 7.6
oriental 7.6
house 7.5
wood 7.5
tourism 7.4
backdrop 7.4
carving 7.4
artwork 7.3
backgrounds 7.3
yellow 7.3
home 7.2
interior 7.1
surface 7.1
textured 7

Google
created on 2022-02-05

Art 81.2
Adaptation 79.2
Rectangle 78.9
Vintage clothing 76.4
Tints and shades 76.3
Beauty 75.4
Event 72.3
Font 71.5
Visual arts 71
Room 70.4
Fashion design 70
Pattern 69.8
Picture frame 65.6
Painting 64.1
Stock photography 63.2
Illustration 61.1
Classic 60.6
Fun 58.7
Photographic paper 58.3
Thigh 56.9

Microsoft
created on 2022-02-05

text 98.1
clothing 97.6
person 96.4
dress 93.4
woman 93.3
posing 70.3
old 45.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Female, 98.7%
Calm 94%
Happy 5%
Sad 0.3%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 97.9%
Surprised 0.6%
Fear 0.5%
Confused 0.4%
Sad 0.2%
Disgusted 0.2%
Calm 0.2%
Angry 0.1%

AWS Rekognition

Age 28-38
Gender Male, 95.7%
Calm 94.7%
Fear 2.5%
Happy 0.8%
Surprised 0.7%
Confused 0.4%
Sad 0.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Calm 56.1%
Angry 27.8%
Fear 6.2%
Sad 3.3%
Confused 2.6%
Surprised 2.3%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 13-21
Gender Female, 99.4%
Calm 75.9%
Happy 14.4%
Angry 5.7%
Confused 1.3%
Sad 0.8%
Surprised 0.7%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 22-30
Gender Female, 67.6%
Calm 98.6%
Happy 0.4%
Sad 0.3%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 99.7%
Calm 84.1%
Confused 12.5%
Happy 1%
Sad 0.9%
Surprised 0.6%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 98.9%
Confused 99.8%
Sad 0%
Calm 0%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 81.6%
Happy 96.2%
Surprised 1.8%
Fear 0.6%
Disgusted 0.4%
Angry 0.4%
Confused 0.3%
Sad 0.2%
Calm 0.2%

AWS Rekognition

Age 16-24
Gender Female, 98.6%
Confused 73.1%
Surprised 14.5%
Sad 3.7%
Happy 3.1%
Fear 2.9%
Disgusted 1.2%
Angry 1%
Calm 0.6%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 90.8%
a group of people posing for a picture 90.7%
a group of people posing for the camera 90.6%