Human Generated Data

Title

Los Angeles, California

Date

1959, printed later

People

Artist: Martin Karplus, American born 1930

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Martin Karplus, 2019.72

Copyright

© Martin Karplus

Human Generated Data

Title

Los Angeles, California

People

Artist: Martin Karplus, American born 1930

Date

1959, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Martin Karplus, 2019.72

Copyright

© Martin Karplus

Machine Generated Data

Tags

Amazon
created on 2023-10-31

Clothing 100
Sun Hat 100
Coat 99.9
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99
Person 99
Female 99
Woman 99
Adult 99
Male 99
Man 99
Person 99
Adult 99
Male 99
Man 99
Person 99
Glove 96.6
Person 95.9
Couch 95.8
Furniture 95.8
Hat 95.1
Person 94.1
Person 93.8
Hat 93.8
People 93.1
Accessories 90.4
Sunglasses 90.4
Bag 90
Handbag 90
Face 87.3
Head 87.3
Person 72.7
Hat 72.6
Glove 69.5
Formal Wear 68.6
Tie 68.6
Cap 62.8
Sitting 62.4
Body Part 61.4
Finger 61.4
Hand 61.4
Photography 60.5
Portrait 60.5
Lady 56.5
Bench 55.3
Suit 55.3
Jacket 55.2

Clarifai
created on 2023-10-31

people 99.2
man 98.5
lid 97.6
woman 97.4
elderly 97.4
group 96.8
adult 96.7
portrait 94.2
veil 89.4
group together 88.6
street 88.5
old 87.8
wear 87
sit 85.1
recreation 85
two 84.5
outdoors 84
music 83.2
three 81.9
several 80.1

Imagga
created on 2023-10-31

man 44.4
male 38.4
person 37.2
people 26.2
helmet 25.1
uniform 23.1
work 22.7
men 22.3
engineer 22.1
safety 22.1
business 20.6
adult 20.5
industry 20.5
occupation 20.2
job 19.5
worker 18.8
portrait 17.5
foreman 16.9
hat 16.8
construction 16.2
businessman 15.9
architect 15.4
building 15.3
looking 15.2
equipment 15
protection 14.5
professional 14.4
mask 13.5
clothing 12.9
industrial 12.7
smile 12.1
manager 12.1
black 12
danger 11.8
happy 11.3
outdoors 10.4
builder 10.3
architecture 10.1
smiling 10.1
20s 10.1
city 10
holding 9.9
suit 9.9
hand 9.9
hardhat 9.8
contractor 9.7
success 9.6
urban 9.6
standing 9.6
engineering 9.5
plan 9.4
site 9.4
outdoor 9.2
old 9
military uniform 9
office 9
working 8.8
project 8.6
profession 8.6
casual 8.5
two 8.5
successful 8.2
laptop 8.2
handsome 8
computer 8
supervisor 7.9
criminal 7.8
crime 7.8
designer 7.7
mid adult 7.7
seller 7.7
workplace 7.6
tie 7.6
sport 7.5
senior 7.5
mature 7.4
indoor 7.3
confident 7.3
group 7.3
color 7.2
team 7.2

Google
created on 2023-10-31

Window 89.7
Hat 89.3
Fashion 87.7
Plant 85.9
Headgear 81.6
Tree 79.1
Sun hat 77.5
Building 77.5
Musician 76.9
Membranophone 76
Event 74.3
Snapshot 74.3
Musical instrument 73
Jewellery 68.9
Tradition 66.7
Sitting 65.8
Music 64.5
Luggage and bags 63.2
Conversation 62.8
Handbag 60.4

Microsoft
created on 2023-10-31

person 99.9
clothing 93.6
people 90.9
outdoor 85.8
man 81
street 78.2
text 68
group 66.4
human face 55.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 75-83
Gender Female, 100%
Sad 92.6%
Confused 32.9%
Angry 3.1%
Calm 0%
Disgusted 0%
Fear 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 54-64
Gender Female, 99.9%
Calm 55.3%
Angry 32.1%
Confused 2.5%
Sad 0.8%
Surprised 0.2%
Fear 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 28-36
Gender Male, 100%
Calm 99.4%
Angry 0.2%
Confused 0%
Sad 0%
Disgusted 0%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 98.4%
Happy 0.2%
Sad 0.1%
Confused 0%
Surprised 0%
Fear 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 71
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Female
Woman
Glove
Hat
Sunglasses
Handbag
Tie
Adult 99.3%
Adult 99%
Adult 99%
Adult 99%
Male 99.3%
Male 99%
Male 99%
Man 99.3%
Man 99%
Man 99%
Person 99.3%
Person 99%
Person 99%
Person 99%
Person 95.9%
Person 94.1%
Person 93.8%
Person 72.7%
Female 99%
Woman 99%
Glove 96.6%
Glove 69.5%
Hat 95.1%
Hat 93.8%
Hat 72.6%
Sunglasses 90.4%
Handbag 90%
Tie 68.6%

Captions

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows a group of people sitting on a bench in an urban setting, with trees and a building in the background. The individuals appear to be from diverse backgrounds, with some wearing colorful or eclectic clothing styles. The scene suggests a diverse, vibrant, and perhaps unconventional group of people gathered in a public space.

Created by claude-3-opus-20240229 on 2025-01-01

The image shows four people sitting on a bench in front of a building, likely a courthouse or government office based on the architecture. The people appear to be an elderly woman in white, an elderly woman wearing red and a colorful scarf, a man in an orange jacket and red hat, and a man in a grey suit with a black hat and sunglasses. Various palm trees and other plants are visible behind them.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This appears to be a vintage photograph taken in what looks like an urban setting, with a building and palm trees visible in the background. The image shows four people seated on what appears to be a bench. On the left are two women in lighter and bright orange clothing, while on the right are two men wearing dark hats, with one in sunglasses. The image seems to capture a moment from what might be the mid-20th century, given the clothing styles and photo quality. The composition suggests this might have been taken in a public space, possibly a park or plaza area.

Text analysis

Amazon

ASSO

Google

AYUNIN ASSOC
AYUNIN
ASSOC