Human Generated Data

Title

Untitled (portrait of a couple sitting outside house)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3395

Human Generated Data

Title

Untitled (portrait of a couple sitting outside house)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3395

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Home Decor 99.8
Clothing 99.7
Apparel 99.7
Person 99.5
Human 99.5
Person 98.4
Tie 95.5
Accessories 95.5
Accessory 95.5
Sailor Suit 92.6
Shirt 91.7
Chair 86.4
Furniture 86.4
Window 84.8
Sleeve 81.6
Shorts 79.2
Plant 74.7
Face 68.5
Curtain 63.2
Portrait 62.7
Photography 62.7
Photo 62.7
Long Sleeve 62.5
Grass 62
Military 61.6
Flooring 61.1
Military Uniform 59.7
Shoe 57.6
Footwear 57.6
Costume 57.1
Flower 56.7
Blossom 56.7
Door 56.5
Officer 56

Clarifai
created on 2023-10-26

people 99.8
adult 96.8
man 93.6
woman 92.9
two 91.3
monochrome 90.3
retro 88.3
portrait 87.8
wedding 87.4
group 87.2
leader 86.6
administration 84.8
family 84.8
wear 82.8
outfit 81.5
veil 79
three 76.2
group together 76
one 74.4
actor 74.1

Imagga
created on 2022-01-22

violin 35.6
bowed stringed instrument 28.7
stringed instrument 24.5
musical instrument 23
man 22.2
people 19
male 17.8
portrait 16.8
person 15.4
statue 13.3
couple 13.1
art 13
black 12.6
old 12.5
adult 11.2
face 10.6
child 10.4
culture 10.2
happiness 10.2
happy 10
traditional 10
dress 9.9
sill 9.7
bride 9.6
love 9.5
men 9.4
wall 9.4
human 9
romantic 8.9
family 8.9
businessman 8.8
sepia 8.7
sculpture 8.6
decoration 8.5
future 8.4
tricycle 8.3
wedding 8.3
wind instrument 8.3
building 8.1
interior 8
business 7.9
smile 7.8
boy 7.8
world 7.8
attractive 7.7
outdoor 7.6
two 7.6
brass 7.5
structural member 7.5
silhouette 7.4
vacation 7.4
light 7.3
lady 7.3
wheeled vehicle 7.3
girls 7.3
room 7.3
women 7.1
architecture 7

Google
created on 2022-01-22

Photograph 94.2
Sleeve 85.9
Gesture 85.3
Picture frame 82.3
Tints and shades 75
Rectangle 73.6
Vintage clothing 71.6
Monochrome photography 69.5
Monochrome 68.2
Room 67.3
Suit 66.5
Stock photography 63.2
Uniform 61.8
Smile 59.6
Formal wear 53.9
Door 52.3
Retro style 52
Font 51.4
Photo caption 50.7
Art 50.2

Microsoft
created on 2022-01-22

text 99.1
window 98.6
posing 95.1
clothing 88.9
standing 88.7
smile 82.2
person 74
black and white 56.7
dress 50.8
image 32.6
picture frame 22.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Calm 85.8%
Happy 5.7%
Confused 2.6%
Sad 2.3%
Fear 1.8%
Angry 1%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 43-51
Gender Male, 98.3%
Calm 51.2%
Happy 15.7%
Confused 15.1%
Sad 11.6%
Angry 2.1%
Surprised 2.1%
Disgusted 1.4%
Fear 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 95.5%
Shoe 57.6%

Categories

Imagga

paintings art 65.2%
streetview architecture 22.1%
interior objects 12.2%

Text analysis

Amazon

11